-- Logs begin at Fri 2022-06-24 09:51:49 UTC, end at Fri 2022-06-24 10:50:00 UTC. -- Jun 24 10:18:16.984150 dv-cinder-836996-38-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 10:18:16.992276 dv-cinder-836996-38-smb devstack@keystone.service[80101]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 10:18:16.994939 dv-cinder-836996-38-smb devstack@keystone.service[80101]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 10:18:16 2022] *** Jun 24 10:18:16.995134 dv-cinder-836996-38-smb devstack@keystone.service[80101]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 10:18:16.995299 dv-cinder-836996-38-smb devstack@keystone.service[80101]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 10:18:16.995451 dv-cinder-836996-38-smb devstack@keystone.service[80101]: nodename: dv-cinder-836996-38-smb Jun 24 10:18:16.995615 dv-cinder-836996-38-smb devstack@keystone.service[80101]: machine: x86_64 Jun 24 10:18:16.995769 dv-cinder-836996-38-smb devstack@keystone.service[80101]: clock source: unix Jun 24 10:18:16.995916 dv-cinder-836996-38-smb devstack@keystone.service[80101]: pcre jit disabled Jun 24 10:18:16.996063 dv-cinder-836996-38-smb devstack@keystone.service[80101]: detected number of CPU cores: 4 Jun 24 10:18:16.996210 dv-cinder-836996-38-smb devstack@keystone.service[80101]: current working directory: / Jun 24 10:18:16.996358 dv-cinder-836996-38-smb devstack@keystone.service[80101]: detected binary path: /usr/bin/uwsgi-core Jun 24 10:18:16.996506 dv-cinder-836996-38-smb devstack@keystone.service[80101]: your processes number limit is 47680 Jun 24 10:18:16.996655 dv-cinder-836996-38-smb devstack@keystone.service[80101]: your memory page size is 4096 bytes Jun 24 10:18:16.996809 dv-cinder-836996-38-smb devstack@keystone.service[80101]: detected max file descriptor number: 2048 Jun 24 10:18:16.996960 dv-cinder-836996-38-smb devstack@keystone.service[80101]: lock engine: pthread robust mutexes Jun 24 10:18:16.997272 dv-cinder-836996-38-smb devstack@keystone.service[80101]: thunder lock: enabled Jun 24 10:18:16.997464 dv-cinder-836996-38-smb devstack@keystone.service[80101]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 10:18:16.997547 dv-cinder-836996-38-smb devstack@keystone.service[80101]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 10:18:17.040918 dv-cinder-836996-38-smb devstack@keystone.service[80101]: Python main interpreter initialized at 0x5586342529c0 Jun 24 10:18:17.040918 dv-cinder-836996-38-smb devstack@keystone.service[80101]: python threads support enabled Jun 24 10:18:17.040918 dv-cinder-836996-38-smb devstack@keystone.service[80101]: your server socket listen backlog is limited to 100 connections Jun 24 10:18:17.040918 dv-cinder-836996-38-smb devstack@keystone.service[80101]: your mercy for graceful operations on workers is 90 seconds Jun 24 10:18:17.041281 dv-cinder-836996-38-smb devstack@keystone.service[80101]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 10:18:17.041353 dv-cinder-836996-38-smb devstack@keystone.service[80101]: *** Operational MODE: preforking *** Jun 24 10:18:17.041619 dv-cinder-836996-38-smb devstack@keystone.service[80101]: *** uWSGI is running in multiple interpreter mode *** Jun 24 10:18:17.041619 dv-cinder-836996-38-smb devstack@keystone.service[80101]: spawned uWSGI master process (pid: 80101) Jun 24 10:18:17.041832 dv-cinder-836996-38-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 24 10:18:17.044702 dv-cinder-836996-38-smb devstack@keystone.service[80101]: spawned uWSGI worker 1 (pid: 80112, cores: 1) Jun 24 10:18:17.044702 dv-cinder-836996-38-smb devstack@keystone.service[80101]: spawned uWSGI worker 2 (pid: 80113, cores: 1) Jun 24 10:18:17.044702 dv-cinder-836996-38-smb devstack@keystone.service[80101]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 10:18:22.500598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:18:22.500598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: from cryptography.utils import int_from_bytes Jun 24 10:18:22.501961 dv-cinder-836996-38-smb devstack@keystone.service[80113]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:18:22.501961 dv-cinder-836996-38-smb devstack@keystone.service[80113]: from cryptography.utils import int_from_bytes Jun 24 10:18:22.503721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:18:22.503721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: from cryptography.utils import int_from_bytes Jun 24 10:18:22.504175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:18:22.504175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: from cryptography.utils import int_from_bytes Jun 24 10:18:22.549531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:18:22.549719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:18:22.549911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] command line args: [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:18:22.550182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:18:22.550370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ================================================================================ {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:18:22.550459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:18:22.550638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] admin_token = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.550729 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:18:22.550834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] command line args: [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:18:22.550911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] config_dir = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.551061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.551135 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:18:22.551244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] config_source = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.551328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ================================================================================ {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:18:22.551458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] debug = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.551578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] admin_token = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.551653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.551916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] config_dir = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.551916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.552110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.552204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] config_source = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.552295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.552392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] debug = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.552501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.552594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.552711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.552813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.552906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.553016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.553367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_config_append = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.553463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.553561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.553561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_dir = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.553745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.553846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_file = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.553939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.554044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.554148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_config_append = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.554148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.554332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.554492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_dir = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.554569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.554688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_file = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.554767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.554845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.554966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.555052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.555123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.555236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.555309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.555490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.555584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.555666 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.555751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.555827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.555944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.556078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.556164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.556329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.556408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.556575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.556698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.556813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.556907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.557051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.557178 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.557288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.557539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.557620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.557743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] publish_errors = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.557816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.557969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.558046 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.558202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.558408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.558574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.558652 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.558775 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] publish_errors = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.558887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.558984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.559101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] standard_threads = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.559220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.559334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.559412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.559579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.559656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.559756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.559865 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.559994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] use_journal = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.560093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] use_json = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.560176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] standard_threads = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.560251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] use_stderr = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.560326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.560441 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] use_syslog = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.560561 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.560652 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.560744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.560884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.560984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] use_journal = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.561098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] use_json = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.561211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.561279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] use_stderr = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.561372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.561445 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] use_syslog = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.561618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.561729 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:18:22.561866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.561950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.562109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.562197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.562375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.562475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.562609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.562689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.562859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.562950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.563108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.563203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.563358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.563447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.563592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.563675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.563888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.564495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.564660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.564742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.564893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.564984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.565112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.565201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.565347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.565436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.565587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.565668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.565838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.566007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.566071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.566129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.566302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.566411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.566609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.567646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.567646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.567800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.567863 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.567921 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.567978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568757 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.568988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.569097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.569192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.569290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.569397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.569491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.569585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.569677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.569844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.569962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.570083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.570203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.570381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.570574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.570710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.570831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.570956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.571069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.571180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.571291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.571402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.571515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.571821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.571821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.572036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.572147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.572256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.572373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.572493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.572608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573596 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.573976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.574044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.574113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.574181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.574264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.574336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.574488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.574592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.574725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.574865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.574975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.575069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.575176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.575272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.575398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.575502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.575649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.575728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.575882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.575962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.576114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.576193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.576343 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.576434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.576602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.576691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.576838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.576917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.577068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.577154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.577305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.577397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.577542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.577626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.577783 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.577903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.578027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.578107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.578269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.578404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.578538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.578616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.578775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.578856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.579010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.579093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.579245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.579322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.579515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.579596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.579754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.579871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.579988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.580074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.580231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.580310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.580469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.580547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.580705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.580791 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.580926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.581038 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.581163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.581242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.581397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.581483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.581644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.581722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.581883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.581962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.582123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.582209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.582374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.582454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.582631 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.582720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.582869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.583022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.583097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.583215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.583326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.583404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.583556 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.583646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.583785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.583872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.584014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.584093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.584248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.584327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.584477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.584566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.584709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.584787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.584941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.585017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.585173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.585259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.585410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.585487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.585648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.585725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.585901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.585995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.586138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.586214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.586384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.external = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.586476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.586619 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.586710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.586904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.586982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.587133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.587210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.external = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.587364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.password = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.587452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.587595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] auth.token = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.587682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.587833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.587918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.588069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.588149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.password = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.588314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.588405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] auth.token = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.588544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.588629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.588781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.588860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.589025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.589111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.589256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.589336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.589492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.589573 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.589736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.589816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.589969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.590047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.590210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.590289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.590493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.590574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.590741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.590826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.590977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.591056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.591218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.591297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.591466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.591545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.591706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.591786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.591955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.592034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.592219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.592297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.592459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.592539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.592717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.592797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.592958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.593035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.593215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.593295 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.593466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.593545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.593705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.593785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.593953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.594032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.594207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.594288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.594464 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.594546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.594717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.594795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.594954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.595034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.595221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.595300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.595468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.595546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.595707 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.595787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.595952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.596031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.596201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.596280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.596438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.596518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.596687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.596772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.596935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.597015 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.597162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.597237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.597392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.597472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.597643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.597722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.597876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.597956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.598113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.598192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.598374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.598467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.598613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.598691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.598855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.598933 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.599088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.599175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.599319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.599399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.599563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.599641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.599795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.599881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.600031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.600110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.600279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.600358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.600523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.600608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.600772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.600850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.601022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.601100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.601260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.601349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.601492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.601571 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.601729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.601809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.601960 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.602047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.602197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.602277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.602459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.602595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.602701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.602845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.602927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.603095 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.603175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.603328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.603407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.603577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.603665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.603823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.603902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.604059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.604138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.604310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.604398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.604557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.604646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.604787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.604866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.605023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.605130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.605251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.605333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.605489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.605567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.605723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.605802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.605962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.606045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.606194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.606273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.606455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.606539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.606695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.606773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.606942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.607020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.607173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.607254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.607410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.607506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.607658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.607739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.607897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.607977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.608131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.608209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.608366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.608446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.608600 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.608680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.608829 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.608908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.609067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.609146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.609300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.609379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.609544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.609622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.609789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.609867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.610026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.610105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.610268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.610345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.610527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.610618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.611291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.611372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.611528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.611607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.611760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.611845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.611994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.612072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.612223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.612302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.612461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.612546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.612696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.612776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.612938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.613016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.613183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.613269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.613428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.613505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.613655 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.613732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.613898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.613985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.614133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.614211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.614381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.614462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.614626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.614717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.614861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.614941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.615098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.615176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.615337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.615423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.615570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.615648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.615824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.615901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.616051 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.616136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.616294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.616372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.616529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.616606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.616762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.616848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.616997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.617076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.617234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.617311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.617472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.617559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.617705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.617784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.617947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.618026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.618189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.618276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.618459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.618541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.618707 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.618784 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.618939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.619029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.619186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.619265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.619436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.619515 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.619681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.619768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.619929 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.620008 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.620165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.620244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.620405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.620559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.620634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] role.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.620712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.620876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.620992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] role.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.621088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.621189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] role.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.621339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.621418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] role.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.621574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.621651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.621819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.621904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.622065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.622145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.622310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.622465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.622586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.622677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.622839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.622919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.623093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.623172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.623334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.623413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.623580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.623659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.623814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.623891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.624059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.624139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.624304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.624383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.624553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.624729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.624822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.624971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.625217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.625297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.625462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.625541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.625708 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.625793 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.625960 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.626038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.626194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.626273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.627025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.627112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.627267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.627345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.627515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.627594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.627749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.627829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.627980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.628060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.628212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.628292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.628448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.628526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.628684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.628763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.628939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.629064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.629162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.629256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.629399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.629504 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.629629 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.629742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.629867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.629972 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.630103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.630208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.630343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.630451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.630602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.630681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.630853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.630931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.631096 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.631182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.631334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.631413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.631577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.631656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.631817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.631908 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.632062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.632140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.632299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.632378 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.632537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.632626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.632773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.632852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.633014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.633092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.633255 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.633342 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.633488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.633567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.633733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.633811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.633967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.634053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.634215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.634294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.connection = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.634541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.634631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.634791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.634871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.connection = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.635032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.635120 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.635274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.635355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.635511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.635590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.635750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.635835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.635987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.636068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.636223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.636303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.636462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.636540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.636695 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.636775 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.636940 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.637021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.637178 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.637277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.637427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.637508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.637663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.637742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.637907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.638023 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.638136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.638217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.638388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.638473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.638631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.638709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.638793 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:18:22.638868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.639103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:18:22.639275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:18:22.668844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.669073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.669305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.669389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.669583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.669825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.678604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.679474 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.706790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.707017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.707643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.707880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.849146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.849349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.896928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.897154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.897898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.898138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.960992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.961190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.961280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.961423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.961523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.961642 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.961736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.961859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.961941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.962073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.962165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.962290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.987434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.987663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.987752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.987888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.987974 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.988113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.988195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.988333 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.988425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.988546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.988629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.988757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.988840 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.988980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:22.999820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.000143 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.012455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.012714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.012834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.012937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.013018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.013121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.013222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.013335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.013427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.013549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.013630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.013764 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.013843 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.013981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 10:18:23.030868 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.031033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.031120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 10:18:23.031249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 10:18:23.031400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.031585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.031668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 10:18:23.031789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 10:18:23.031872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.032060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.032141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.032323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.032405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.033104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.033191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.033361 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.043795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.044070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.044200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.044336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.044479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.044615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.044750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.045034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.053633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.054160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.056914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.057192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.057474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.057555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.057751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.057834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.058029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.058113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.058285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.058389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.058575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.058669 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.058845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.058927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.059110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.059192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.059378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.059468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.059638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.059720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.059909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.060177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.085761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.086801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.087388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.087664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.088419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.088700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.092852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.093240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.093518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.093982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.094404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.094694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.101294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.101531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.102517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.102802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.106050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.106332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.106635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.106913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.107186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.107286 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.107455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.107573 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.107719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.107858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.107980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.108143 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.108419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.108693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.108962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.109230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.127093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.127366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.128365 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.128645 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.131969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.133246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.135589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.135980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.136912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.137318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.140973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.142428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.144603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.146029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.148261 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.148557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.148838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.149117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.149391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.149662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.149751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.150034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.150321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.150633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.150914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.151193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.169032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.169313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.169579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.169845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.170772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.171059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.171330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.171602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.178570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.180259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.180418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.180534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.182051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.182333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.183789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.184087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.184383 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.184680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.185008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.185654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.185935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.186215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.186521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.186805 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.198167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.198474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.198752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.199035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.200091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.200374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.200514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.200663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.200808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.200944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.201102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.202477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.202786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.203087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.218852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.221500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.222636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.224841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.225902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.227647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.228169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.229262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.229538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.229817 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.229923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.231596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.231878 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.232161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.237700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.239327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.240082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.241705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.242536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.242823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.243205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.243477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.245055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.245346 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.245737 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.246017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.252551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.252823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.253103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.255200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.255489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.255769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.260893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.261170 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.261444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.261715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.261984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.262347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.262650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.262932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.263200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.263468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.263679 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 10:18:23.263762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.263961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.264042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.264241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.264322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.264514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.264603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.264789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.265168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.265455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.265737 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.266011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.266283 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.266597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.266858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.267661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.267936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 10:18:23.303627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586342529c0 pid: 80113 (default app) Jun 24 10:18:23.306385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586342529c0 pid: 80112 (default app) Jun 24 10:18:23.307006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d666-838c-4563-9d9c-5da2ce476a1e None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:23.307311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d666-838c-4563-9d9c-5da2ce476a1e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:23.307590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d666-838c-4563-9d9c-5da2ce476a1e None None] PATH_INFO: `/v3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:23.311695 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Fri Jun 24 10:18:23 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:30.972967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87142c7d-b476-4152-99c0-8ee83ae630ef None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:30.973499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87142c7d-b476-4152-99c0-8ee83ae630ef None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:30.973499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87142c7d-b476-4152-99c0-8ee83ae630ef None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:30.977724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:30.983164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:30.983597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:30.983728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:31.052953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: INFO dbcounter [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] Registered counter for database keystone Jun 24 10:18:31.073636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG oslo_db.sqlalchemy.engines [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:18:31.080349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writer thread running {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:18:31.270336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG passlib.handlers.bcrypt [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80113) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 10:18:31.270770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG passlib.handlers.bcrypt [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80113) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 10:18:31.327057 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:31.328666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:31.456561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 10:18:31.601345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87142c7d-b476-4152-99c0-8ee83ae630ef None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:31.675282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: INFO dbcounter [None req-87142c7d-b476-4152-99c0-8ee83ae630ef None None] Registered counter for database keystone Jun 24 10:18:31.695523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG oslo_db.sqlalchemy.engines [None req-87142c7d-b476-4152-99c0-8ee83ae630ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:18:31.702319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writer thread running {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:18:31.826735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87142c7d-b476-4152-99c0-8ee83ae630ef None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:31.830884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e68c-2e50-4644-b3b7-e70d9e1b1f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:31.831546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e68c-2e50-4644-b3b7-e70d9e1b1f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:31.831832 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e68c-2e50-4644-b3b7-e70d9e1b1f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:31.832109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e68c-2e50-4644-b3b7-e70d9e1b1f4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:31.841041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e68c-2e50-4644-b3b7-e70d9e1b1f4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:31.895857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d4a5e68c-2e50-4644-b3b7-e70d9e1b1f4a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 10:18:31.896202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e68c-2e50-4644-b3b7-e70d9e1b1f4a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:31.908109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Fri Jun 24 10:18:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:18:31.913989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:31.929594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe9ae-f2dc-48c5-848d-dea31964c8f8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:31.934056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e99cd-0f52-4011-bd81-5ad2e4a1197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:31.935306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e99cd-0f52-4011-bd81-5ad2e4a1197a admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:31.935599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e99cd-0f52-4011-bd81-5ad2e4a1197a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:31.935882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e99cd-0f52-4011-bd81-5ad2e4a1197a admin admin] PATH_INFO: `/v3/projects/f43b9dcf7aae4875bca38a800d08c70f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:31.939995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e99cd-0f52-4011-bd81-5ad2e4a1197a admin admin] RBAC: Authorizing `identity:get_project(project_id=f43b9dcf7aae4875bca38a800d08c70f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:31.991163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WARNING keystone.common.rbac_enforcer.enforcer [None req-650e99cd-0f52-4011-bd81-5ad2e4a1197a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 10:18:31.991745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e99cd-0f52-4011-bd81-5ad2e4a1197a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:31.996158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Fri Jun 24 10:18:31 2022] GET /identity/v3/projects/f43b9dcf7aae4875bca38a800d08c70f => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:33.982541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7dbc8-c83c-4621-a5fa-318b44561346 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:33.983047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7dbc8-c83c-4621-a5fa-318b44561346 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:33.983047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7dbc8-c83c-4621-a5fa-318b44561346 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:33.987127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:33.992458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f39e93-8c0d-420b-a84f-d77d4cfec061 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:33.992857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f39e93-8c0d-420b-a84f-d77d4cfec061 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:33.993024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f39e93-8c0d-420b-a84f-d77d4cfec061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:34.011428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-95f39e93-8c0d-420b-a84f-d77d4cfec061 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:34.012938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-95f39e93-8c0d-420b-a84f-d77d4cfec061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:34.021287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 10:18:34.043834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7dbc8-c83c-4621-a5fa-318b44561346 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:34.056050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7dbc8-c83c-4621-a5fa-318b44561346 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:34.060277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807c87b-547f-40cd-9b23-6ca37e80ad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:34.060896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807c87b-547f-40cd-9b23-6ca37e80ad46 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:34.061186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807c87b-547f-40cd-9b23-6ca37e80ad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:34.061466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807c87b-547f-40cd-9b23-6ca37e80ad46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:34.069178 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807c87b-547f-40cd-9b23-6ca37e80ad46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:34.070997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807c87b-547f-40cd-9b23-6ca37e80ad46 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:34.080259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Fri Jun 24 10:18:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:18:34.085390 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f39e93-8c0d-420b-a84f-d77d4cfec061 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:34.094814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f39e93-8c0d-420b-a84f-d77d4cfec061 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:34.099182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ffdc5-203d-47d0-9bb7-797c37cb49a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:34.100033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ffdc5-203d-47d0-9bb7-797c37cb49a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:34.100321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ffdc5-203d-47d0-9bb7-797c37cb49a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:34.100601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ffdc5-203d-47d0-9bb7-797c37cb49a2 admin admin] PATH_INFO: `/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:34.101977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ffdc5-203d-47d0-9bb7-797c37cb49a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=7e9b1eea1bc44e2ab2c9802f041f72c3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:34.103817 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ffdc5-203d-47d0-9bb7-797c37cb49a2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:34.105367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Fri Jun 24 10:18:34 2022] GET /identity/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:36.170009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0a9d-9d47-420d-9faf-3c3f83297680 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:36.170571 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0a9d-9d47-420d-9faf-3c3f83297680 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:36.170661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0a9d-9d47-420d-9faf-3c3f83297680 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:36.172668 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:18:36.177778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bebc84-3398-4e10-ba9e-16c1c4476654 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:36.178171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bebc84-3398-4e10-ba9e-16c1c4476654 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:36.178378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bebc84-3398-4e10-ba9e-16c1c4476654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:36.195216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-90bebc84-3398-4e10-ba9e-16c1c4476654 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:36.196403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-90bebc84-3398-4e10-ba9e-16c1c4476654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:36.204132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965f4a0-e8d9-4322-8b73-4552fa98b290 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:36.204625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965f4a0-e8d9-4322-8b73-4552fa98b290 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:36.205121 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965f4a0-e8d9-4322-8b73-4552fa98b290 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:36.207137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:18:36.212621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c7a62-20e4-4193-a4c0-78e44422802d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:36.212904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c7a62-20e4-4193-a4c0-78e44422802d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:36.213179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c7a62-20e4-4193-a4c0-78e44422802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:36.253804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG passlib.handlers.bcrypt [None req-b64c7a62-20e4-4193-a4c0-78e44422802d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80112) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 10:18:36.254224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG passlib.handlers.bcrypt [None req-b64c7a62-20e4-4193-a4c0-78e44422802d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80112) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 10:18:36.281801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:36.299547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b64c7a62-20e4-4193-a4c0-78e44422802d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:36.301138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b64c7a62-20e4-4193-a4c0-78e44422802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:36.305849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bebc84-3398-4e10-ba9e-16c1c4476654 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:36.329771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:36.406485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:18:36.412239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bebc84-3398-4e10-ba9e-16c1c4476654 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:36.429780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c7a62-20e4-4193-a4c0-78e44422802d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:36.446610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d17c-9593-4e26-88b1-a6ff09e2b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:36.447412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d17c-9593-4e26-88b1-a6ff09e2b044 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:36.447704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d17c-9593-4e26-88b1-a6ff09e2b044 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:36.447990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d17c-9593-4e26-88b1-a6ff09e2b044 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:36.459070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243d17c-9593-4e26-88b1-a6ff09e2b044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-9243d17c-9593-4e26-88b1-a6ff09e2b044 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:36.470731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:36.471663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:18:36.472512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:18:36.477695 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d17c-9593-4e26-88b1-a6ff09e2b044 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:36.529769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c7a62-20e4-4193-a4c0-78e44422802d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:36.532788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:36.559526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:36.570636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c71eb0-8741-4ea1-91c1-1d31f6721e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:36.572282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71eb0-8741-4ea1-91c1-1d31f6721e11 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:36.572654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71eb0-8741-4ea1-91c1-1d31f6721e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:36.572852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71eb0-8741-4ea1-91c1-1d31f6721e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:36.578959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d17c-9593-4e26-88b1-a6ff09e2b044 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:36.613070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5009af6-a0a6-4c9a-8bde-677507ea71bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:36.613734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5009af6-a0a6-4c9a-8bde-677507ea71bd None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:36.614024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5009af6-a0a6-4c9a-8bde-677507ea71bd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:36.614307 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5009af6-a0a6-4c9a-8bde-677507ea71bd None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:36.615101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5009af6-a0a6-4c9a-8bde-677507ea71bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:36.615415 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5009af6-a0a6-4c9a-8bde-677507ea71bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:36.616824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5009af6-a0a6-4c9a-8bde-677507ea71bd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:36.628536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:36.634150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5009af6-a0a6-4c9a-8bde-677507ea71bd None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:36.640051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c71eb0-8741-4ea1-91c1-1d31f6721e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:36.641594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c71eb0-8741-4ea1-91c1-1d31f6721e11 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:36.732074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5009af6-a0a6-4c9a-8bde-677507ea71bd None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:36.738699 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:18:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:36.744302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c71eb0-8741-4ea1-91c1-1d31f6721e11 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:36.747000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:36.766887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c117f-d0e9-4444-a954-4efa0c23baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:36.767760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c117f-d0e9-4444-a954-4efa0c23baea None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:36.768046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c117f-d0e9-4444-a954-4efa0c23baea None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:36.768326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c117f-d0e9-4444-a954-4efa0c23baea None admin] PATH_INFO: `/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:36.769526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c117f-d0e9-4444-a954-4efa0c23baea None admin] RBAC: Authorizing `identity:get_user(user_id=7e9b1eea1bc44e2ab2c9802f041f72c3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:36.771022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c117f-d0e9-4444-a954-4efa0c23baea None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:36.772635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:36 2022] GET /identity/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:36.777846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c117f-d0e9-4444-a954-4efa0c23baea None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:36.792204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:36.846771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c71eb0-8741-4ea1-91c1-1d31f6721e11 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:36.875926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c117f-d0e9-4444-a954-4efa0c23baea None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:36.879146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1f914-f1bc-43d3-9a09-b11dc1acafc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:36.879931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1f914-f1bc-43d3-9a09-b11dc1acafc7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:36.880217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1f914-f1bc-43d3-9a09-b11dc1acafc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:36.880496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1f914-f1bc-43d3-9a09-b11dc1acafc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:36.899082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1f914-f1bc-43d3-9a09-b11dc1acafc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:36.900543 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1f914-f1bc-43d3-9a09-b11dc1acafc7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:36.911786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc86c8c-e016-4d72-9670-9b560d8a0f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:36.912576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc86c8c-e016-4d72-9670-9b560d8a0f91 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:36.912867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc86c8c-e016-4d72-9670-9b560d8a0f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:36.913150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc86c8c-e016-4d72-9670-9b560d8a0f91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:36.914334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc86c8c-e016-4d72-9670-9b560d8a0f91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:36.915799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc86c8c-e016-4d72-9670-9b560d8a0f91 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:36.917394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:18:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:36.923153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc86c8c-e016-4d72-9670-9b560d8a0f91 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-e3f1f914-f1bc-43d3-9a09-b11dc1acafc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:18:36.923274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:36.924027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:36.924829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:18:36.924829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:18:36.924829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:18:36.924829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:18:36.924829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:18:36.930215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1f914-f1bc-43d3-9a09-b11dc1acafc7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:36.986296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:37.004037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:37.023320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc86c8c-e016-4d72-9670-9b560d8a0f91 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:37.030800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1f914-f1bc-43d3-9a09-b11dc1acafc7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:37.056858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6c4fc-ac5e-4292-9721-5bebb7d1ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:37.057722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6c4fc-ac5e-4292-9721-5bebb7d1ecc5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:37.058012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6c4fc-ac5e-4292-9721-5bebb7d1ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:37.058298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6c4fc-ac5e-4292-9721-5bebb7d1ecc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:37.059170 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6c4fc-ac5e-4292-9721-5bebb7d1ecc5 None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.domain.id=default, user.id=7e9b1eea1bc44e2ab2c9802f041f72c3) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:37.059489 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6c4fc-ac5e-4292-9721-5bebb7d1ecc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:37.060923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6c4fc-ac5e-4292-9721-5bebb7d1ecc5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:37.064415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69f248-db0f-46cf-86da-2c9234e45d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:37.065330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69f248-db0f-46cf-86da-2c9234e45d11 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:37.065621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69f248-db0f-46cf-86da-2c9234e45d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:37.065902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69f248-db0f-46cf-86da-2c9234e45d11 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:37.066663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69f248-db0f-46cf-86da-2c9234e45d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:37.066973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69f248-db0f-46cf-86da-2c9234e45d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:37.067850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Fri Jun 24 10:18:36 2022] GET /identity/v3/role_assignments?user.id=7e9b1eea1bc44e2ab2c9802f041f72c3&scope.domain.id=default&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:37.068354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69f248-db0f-46cf-86da-2c9234e45d11 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:37.088064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:39.388791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cbd5e-d1ad-4fba-b445-8afd2fd5b318 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:39.389294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cbd5e-d1ad-4fba-b445-8afd2fd5b318 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:39.389394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cbd5e-d1ad-4fba-b445-8afd2fd5b318 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:39.395040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:39.412473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86609e-5192-4c4d-a367-e2e79e8adc01 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:39.412918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86609e-5192-4c4d-a367-e2e79e8adc01 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:39.413108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86609e-5192-4c4d-a367-e2e79e8adc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:39.443291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bb86609e-5192-4c4d-a367-e2e79e8adc01 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:39.444508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bb86609e-5192-4c4d-a367-e2e79e8adc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:39.540459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bcb06-b652-42ab-b09c-e0c0cab8d724 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:39.540767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bcb06-b652-42ab-b09c-e0c0cab8d724 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:39.541037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bcb06-b652-42ab-b09c-e0c0cab8d724 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:39.542683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 13/23] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:39.548119 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8c273-471a-4444-9f32-5dd38d414dc1 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:39.548411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8c273-471a-4444-9f32-5dd38d414dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:39.548692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8c273-471a-4444-9f32-5dd38d414dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:39.552646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 11/24] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:39.575341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-84f8c273-471a-4444-9f32-5dd38d414dc1 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:39.576557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-84f8c273-471a-4444-9f32-5dd38d414dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:39.581200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86609e-5192-4c4d-a367-e2e79e8adc01 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:39.686816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:39.728310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86609e-5192-4c4d-a367-e2e79e8adc01 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:39.729794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 14/25] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:18:39.731320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbefec2-7ff0-454d-8c74-9b40b0801a86 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:39.732516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbefec2-7ff0-454d-8c74-9b40b0801a86 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:39.732953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbefec2-7ff0-454d-8c74-9b40b0801a86 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:39.739708 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 15/26] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:39.747656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c3606-1794-4b1f-9962-bd7e52b2c710 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:39.748126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c3606-1794-4b1f-9962-bd7e52b2c710 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:39.748565 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c3606-1794-4b1f-9962-bd7e52b2c710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:39.766816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-539c3606-1794-4b1f-9962-bd7e52b2c710 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:39.769023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-539c3606-1794-4b1f-9962-bd7e52b2c710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:39.805264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd321d-6c6f-4b8c-ac7d-60289dad0f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:39.807326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd321d-6c6f-4b8c-ac7d-60289dad0f35 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:39.810862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd321d-6c6f-4b8c-ac7d-60289dad0f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:39.811293 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd321d-6c6f-4b8c-ac7d-60289dad0f35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:39.836097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd321d-6c6f-4b8c-ac7d-60289dad0f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-19fd321d-6c6f-4b8c-ac7d-60289dad0f35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:39.847403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:39.848503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:39.849458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:18:39.851685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 12/27] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:18:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:39.852635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd321d-6c6f-4b8c-ac7d-60289dad0f35 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:39.892659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 16/28] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:39.893600 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c3606-1794-4b1f-9962-bd7e52b2c710 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:39.902656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:40.057421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd321d-6c6f-4b8c-ac7d-60289dad0f35 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:40.070561 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:40.087912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c3606-1794-4b1f-9962-bd7e52b2c710 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:40.130246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ca90e-a100-4239-8e87-7bcf0db2fe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:40.131069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ca90e-a100-4239-8e87-7bcf0db2fe15 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:40.131354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ca90e-a100-4239-8e87-7bcf0db2fe15 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:40.131630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ca90e-a100-4239-8e87-7bcf0db2fe15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:40.151972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ace65-6669-4686-a863-204f145af443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:40.152644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ace65-6669-4686-a863-204f145af443 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:40.152927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ace65-6669-4686-a863-204f145af443 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:40.153202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ace65-6669-4686-a863-204f145af443 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:40.153951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ace65-6669-4686-a863-204f145af443 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:40.154258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ace65-6669-4686-a863-204f145af443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:40.155676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ace65-6669-4686-a863-204f145af443 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:40.158663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ca90e-a100-4239-8e87-7bcf0db2fe15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:40.160123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ca90e-a100-4239-8e87-7bcf0db2fe15 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:40.182157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 17/29] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:40.183027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ace65-6669-4686-a863-204f145af443 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-474ca90e-a100-4239-8e87-7bcf0db2fe15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:18:40.191606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:40.192421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:40.193218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:18:40.193218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:18:40.193218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:18:40.193218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:18:40.193218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 13/30] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:40.197938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ca90e-a100-4239-8e87-7bcf0db2fe15 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:40.310804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:40.382336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ace65-6669-4686-a863-204f145af443 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:40.393421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ca90e-a100-4239-8e87-7bcf0db2fe15 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:40.417561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a004a6-8060-48bb-afd0-ddba31c43d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:40.418825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a004a6-8060-48bb-afd0-ddba31c43d6a None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:40.419265 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a004a6-8060-48bb-afd0-ddba31c43d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:40.419674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a004a6-8060-48bb-afd0-ddba31c43d6a None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:40.420573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a004a6-8060-48bb-afd0-ddba31c43d6a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:40.422716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a004a6-8060-48bb-afd0-ddba31c43d6a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:40.433866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b79434-aebc-4822-a9a9-6ad4542cc271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:40.434817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79434-aebc-4822-a9a9-6ad4542cc271 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:40.435145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79434-aebc-4822-a9a9-6ad4542cc271 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:40.435433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79434-aebc-4822-a9a9-6ad4542cc271 None admin] PATH_INFO: `/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:40.437249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b79434-aebc-4822-a9a9-6ad4542cc271 None admin] RBAC: Authorizing `identity:get_user(user_id=7e9b1eea1bc44e2ab2c9802f041f72c3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:40.442585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b79434-aebc-4822-a9a9-6ad4542cc271 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:40.445520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 14/31] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:40 2022] GET /identity/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:40.446342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b79434-aebc-4822-a9a9-6ad4542cc271 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:40.485367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:40.560339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 18/32] 10.222.0.44 () {60 vars in 1131 bytes} [Fri Jun 24 10:18:40 2022] POST /identity/v3/roles => generated 219 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:18:40.566534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b79434-aebc-4822-a9a9-6ad4542cc271 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:40.568877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f447d-b984-4828-b953-db844ac6f26a None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:40.569318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f447d-b984-4828-b953-db844ac6f26a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:40.569735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f447d-b984-4828-b953-db844ac6f26a None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:40.571269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 19/33] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:40.580483 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f447d-b984-4828-b953-db844ac6f26a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:40.613478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af090c-03da-4662-b2a2-0e06965bc118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:40.614168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af090c-03da-4662-b2a2-0e06965bc118 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:40.614541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af090c-03da-4662-b2a2-0e06965bc118 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:40.614812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af090c-03da-4662-b2a2-0e06965bc118 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:40.615559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af090c-03da-4662-b2a2-0e06965bc118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:40.615870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af090c-03da-4662-b2a2-0e06965bc118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:40.617703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af090c-03da-4662-b2a2-0e06965bc118 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:40.645601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 15/34] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:40.647110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae58c-e607-40f5-85bb-0b7232f41dd9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:40.647405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae58c-e607-40f5-85bb-0b7232f41dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:40.647689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae58c-e607-40f5-85bb-0b7232f41dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:40.679227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f7cae58c-e607-40f5-85bb-0b7232f41dd9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:40.680454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f7cae58c-e607-40f5-85bb-0b7232f41dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:40.708427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f447d-b984-4828-b953-db844ac6f26a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:40.737588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:40.748868 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40bdef-2525-4c1a-afa8-5dcf102d59da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:40.749989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bdef-2525-4c1a-afa8-5dcf102d59da None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:40.750742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bdef-2525-4c1a-afa8-5dcf102d59da None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:40.751348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bdef-2525-4c1a-afa8-5dcf102d59da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:40.752931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40bdef-2525-4c1a-afa8-5dcf102d59da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:40.755130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40bdef-2525-4c1a-afa8-5dcf102d59da None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:40.757699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 20/35] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:18:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:40.759077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40bdef-2525-4c1a-afa8-5dcf102d59da None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:40.845097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 16/36] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:40.845097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae58c-e607-40f5-85bb-0b7232f41dd9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:40.866535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:40.897328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40bdef-2525-4c1a-afa8-5dcf102d59da None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:40.938068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba042fc8-620b-4cd9-a7d2-fef3f5fdf41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:40.938768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042fc8-620b-4cd9-a7d2-fef3f5fdf41c None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:40.939057 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042fc8-620b-4cd9-a7d2-fef3f5fdf41c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:40.939334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042fc8-620b-4cd9-a7d2-fef3f5fdf41c None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:40.940339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba042fc8-620b-4cd9-a7d2-fef3f5fdf41c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:40.941499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba042fc8-620b-4cd9-a7d2-fef3f5fdf41c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:40.958079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae58c-e607-40f5-85bb-0b7232f41dd9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:40.970848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 21/37] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:18:40 2022] POST /identity/v3/projects => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:18:40.972181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf6ea0-3348-4874-8152-c93985a18df7 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:40.972478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf6ea0-3348-4874-8152-c93985a18df7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:40.972767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf6ea0-3348-4874-8152-c93985a18df7 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:40.974221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 22/38] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:40.974800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf6ea0-3348-4874-8152-c93985a18df7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:41.012514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54df31-b716-479a-a14d-7ea08793533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:41.013856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54df31-b716-479a-a14d-7ea08793533e None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:41.014588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54df31-b716-479a-a14d-7ea08793533e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:41.015154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54df31-b716-479a-a14d-7ea08793533e None admin] PATH_INFO: `/v3/domains/default/users/7e9b1eea1bc44e2ab2c9802f041f72c3/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:41.017700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54df31-b716-479a-a14d-7ea08793533e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7e9b1eea1bc44e2ab2c9802f041f72c3, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:41.019511 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54df31-b716-479a-a14d-7ea08793533e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:41.029790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:41.097645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf6ea0-3348-4874-8152-c93985a18df7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:41.142834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84a47d-54cf-4a85-9f58-71a7e9da0dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:41.143495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84a47d-54cf-4a85-9f58-71a7e9da0dd6 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:41.144636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84a47d-54cf-4a85-9f58-71a7e9da0dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:41.144636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84a47d-54cf-4a85-9f58-71a7e9da0dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:41.144805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84a47d-54cf-4a85-9f58-71a7e9da0dd6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:41.146926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84a47d-54cf-4a85-9f58-71a7e9da0dd6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:41.166244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 23/39] 10.222.0.44 () {60 vars in 1131 bytes} [Fri Jun 24 10:18:40 2022] POST /identity/v3/roles => generated 225 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:18:41.168052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f84d-4514-4e8a-9fff-d6607b60bffa None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:41.168592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f84d-4514-4e8a-9fff-d6607b60bffa None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:41.169168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f84d-4514-4e8a-9fff-d6607b60bffa None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:41.170644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 24/40] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:41.172918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0dcec-bf43-409d-a4f6-6ef727b0f9d7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:41.173578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0dcec-bf43-409d-a4f6-6ef727b0f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:41.174060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0dcec-bf43-409d-a4f6-6ef727b0f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:41.183955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 17/41] 10.222.0.44 () {58 vars in 1361 bytes} [Fri Jun 24 10:18:40 2022] PUT /identity/v3/domains/default/users/7e9b1eea1bc44e2ab2c9802f041f72c3/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:18:41.192440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cedb4b-0886-40d3-8965-ac32fb2fa239 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:41.192772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cedb4b-0886-40d3-8965-ac32fb2fa239 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:41.193013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cedb4b-0886-40d3-8965-ac32fb2fa239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:41.199202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-47b0dcec-bf43-409d-a4f6-6ef727b0f9d7 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:41.201388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-47b0dcec-bf43-409d-a4f6-6ef727b0f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:41.258415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-27cedb4b-0886-40d3-8965-ac32fb2fa239 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:41.258415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-27cedb4b-0886-40d3-8965-ac32fb2fa239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:41.303325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 25/42] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:41.333762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0dcec-bf43-409d-a4f6-6ef727b0f9d7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:41.365507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 18/43] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:41.389227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cedb4b-0886-40d3-8965-ac32fb2fa239 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:41.393140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:41.405101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:41.499184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0dcec-bf43-409d-a4f6-6ef727b0f9d7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:41.538872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cedb4b-0886-40d3-8965-ac32fb2fa239 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:41.585434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83cf28-f407-4a40-bb0c-c54074815b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:41.586137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83cf28-f407-4a40-bb0c-c54074815b5a None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:41.586453 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83cf28-f407-4a40-bb0c-c54074815b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:41.586736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83cf28-f407-4a40-bb0c-c54074815b5a None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:41.587509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83cf28-f407-4a40-bb0c-c54074815b5a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:41.594768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83cf28-f407-4a40-bb0c-c54074815b5a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:41.615317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 19/44] 10.222.0.44 () {60 vars in 1131 bytes} [Fri Jun 24 10:18:41 2022] POST /identity/v3/roles => generated 223 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:18:41.647655 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f98f2-fd54-4cac-b665-ba877612f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:41.648397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f98f2-fd54-4cac-b665-ba877612f574 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:41.648688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f98f2-fd54-4cac-b665-ba877612f574 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:41.648969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f98f2-fd54-4cac-b665-ba877612f574 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:41.650236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f98f2-fd54-4cac-b665-ba877612f574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:41.651798 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f98f2-fd54-4cac-b665-ba877612f574 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:41.653733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 26/45] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:18:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:41.659266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83cf28-f407-4a40-bb0c-c54074815b5a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:41.733194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:41.774939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83cf28-f407-4a40-bb0c-c54074815b5a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:41.810972 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b48f8-56ed-40a5-a309-e70a1dde9066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:41.811938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b48f8-56ed-40a5-a309-e70a1dde9066 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:41.812228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b48f8-56ed-40a5-a309-e70a1dde9066 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:41.813094 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b48f8-56ed-40a5-a309-e70a1dde9066 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:41.813828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b48f8-56ed-40a5-a309-e70a1dde9066 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:41.815462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b48f8-56ed-40a5-a309-e70a1dde9066 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:41.843368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 20/46] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:18:41 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:18:43.287050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e625-b5c6-44ee-8911-c71a8ee0f608 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:43.287563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e625-b5c6-44ee-8911-c71a8ee0f608 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:43.287644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e625-b5c6-44ee-8911-c71a8ee0f608 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:43.288973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 27/47] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:43.294260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ad8aa-802b-4ce3-99cb-1696e8f52a7a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:43.294706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ad8aa-802b-4ce3-99cb-1696e8f52a7a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:43.294861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ad8aa-802b-4ce3-99cb-1696e8f52a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:43.311822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4e5ad8aa-802b-4ce3-99cb-1696e8f52a7a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:43.313024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4e5ad8aa-802b-4ce3-99cb-1696e8f52a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:43.378173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 21/48] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:43.400636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91e625-b5c6-44ee-8911-c71a8ee0f608 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:43.502638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91e625-b5c6-44ee-8911-c71a8ee0f608 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:43.504973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:43.536930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d3333-67cf-4e58-938d-0e1305c8280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:43.537772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d3333-67cf-4e58-938d-0e1305c8280d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:43.538010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d3333-67cf-4e58-938d-0e1305c8280d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:43.538290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d3333-67cf-4e58-938d-0e1305c8280d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:43.548470 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d3333-67cf-4e58-938d-0e1305c8280d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-329d3333-67cf-4e58-938d-0e1305c8280d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:43.556274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:43.557275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:18:43.558115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 28/49] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:43.565095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ad8aa-802b-4ce3-99cb-1696e8f52a7a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:43.614125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:43.666759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ad8aa-802b-4ce3-99cb-1696e8f52a7a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:43.699809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14789d-dd38-4d5b-8e2e-cc341bb63c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:43.700476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14789d-dd38-4d5b-8e2e-cc341bb63c9b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:43.700769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14789d-dd38-4d5b-8e2e-cc341bb63c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:43.701054 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14789d-dd38-4d5b-8e2e-cc341bb63c9b None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:43.701810 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14789d-dd38-4d5b-8e2e-cc341bb63c9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:43.702126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14789d-dd38-4d5b-8e2e-cc341bb63c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:43.704082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14789d-dd38-4d5b-8e2e-cc341bb63c9b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:43.716550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 22/50] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:43.722625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d3333-67cf-4e58-938d-0e1305c8280d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:43.821223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d3333-67cf-4e58-938d-0e1305c8280d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:43.854850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77f64-3c9b-482c-bc12-b4060996ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:43.855728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77f64-3c9b-482c-bc12-b4060996ae95 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:43.856019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77f64-3c9b-482c-bc12-b4060996ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:43.856301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77f64-3c9b-482c-bc12-b4060996ae95 None admin] PATH_INFO: `/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:43.857508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e77f64-3c9b-482c-bc12-b4060996ae95 None admin] RBAC: Authorizing `identity:get_user(user_id=7e9b1eea1bc44e2ab2c9802f041f72c3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:43.859063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e77f64-3c9b-482c-bc12-b4060996ae95 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:43.859472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737bb8-7384-4084-97ff-fa4aa5adeadc None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:43.859769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737bb8-7384-4084-97ff-fa4aa5adeadc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:43.860053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737bb8-7384-4084-97ff-fa4aa5adeadc None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:43.860699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 29/51] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:43 2022] GET /identity/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:43.861417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 23/52] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:18:43.865968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77f64-3c9b-482c-bc12-b4060996ae95 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:43.866489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f49930-bde9-4724-8671-8d0dc8ab1ac9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:43.866820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f49930-bde9-4724-8671-8d0dc8ab1ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:43.867111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f49930-bde9-4724-8671-8d0dc8ab1ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:43.898797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:43.971273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77f64-3c9b-482c-bc12-b4060996ae95 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:43.986794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-87f49930-bde9-4724-8671-8d0dc8ab1ac9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:43.988050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-87f49930-bde9-4724-8671-8d0dc8ab1ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:44.005038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b6445-dc9f-4c2a-a893-67136e6c3a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:44.005835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b6445-dc9f-4c2a-a893-67136e6c3a4a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:44.006126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b6445-dc9f-4c2a-a893-67136e6c3a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:44.006433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b6445-dc9f-4c2a-a893-67136e6c3a4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:44.007621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b6445-dc9f-4c2a-a893-67136e6c3a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:44.009056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b6445-dc9f-4c2a-a893-67136e6c3a4a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:44.010705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 30/53] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:18:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:44.016865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b6445-dc9f-4c2a-a893-67136e6c3a4a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:44.055152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 24/54] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:18:44.079140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f49930-bde9-4724-8671-8d0dc8ab1ac9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:44.112115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:44.115503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b6445-dc9f-4c2a-a893-67136e6c3a4a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:44.118659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:44.149710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75f537-926e-4027-8d11-a3c2aed204fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:44.150392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75f537-926e-4027-8d11-a3c2aed204fb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:44.150690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75f537-926e-4027-8d11-a3c2aed204fb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:44.150975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75f537-926e-4027-8d11-a3c2aed204fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:44.151814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75f537-926e-4027-8d11-a3c2aed204fb None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.domain.id=default, user.id=7e9b1eea1bc44e2ab2c9802f041f72c3) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:44.152134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75f537-926e-4027-8d11-a3c2aed204fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:44.153579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75f537-926e-4027-8d11-a3c2aed204fb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:44.159376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 31/55] 10.222.0.44 () {56 vars in 1322 bytes} [Fri Jun 24 10:18:44 2022] GET /identity/v3/role_assignments?user.id=7e9b1eea1bc44e2ab2c9802f041f72c3&scope.domain.id=default&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:44.179205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f49930-bde9-4724-8671-8d0dc8ab1ac9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:44.217715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19899caf-a16b-490e-8874-c74ef9b9d58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:44.218600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899caf-a16b-490e-8874-c74ef9b9d58a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:44.218887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899caf-a16b-490e-8874-c74ef9b9d58a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:44.219170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19899caf-a16b-490e-8874-c74ef9b9d58a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:44.220398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19899caf-a16b-490e-8874-c74ef9b9d58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:44.221867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19899caf-a16b-490e-8874-c74ef9b9d58a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:44.223829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 25/56] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:18:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:44.229401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75f537-926e-4027-8d11-a3c2aed204fb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:44.346036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75f537-926e-4027-8d11-a3c2aed204fb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:44.380076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96175c-a2e6-402f-ac11-ac27f045a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:44.380738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96175c-a2e6-402f-ac11-ac27f045a25b None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:44.381029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96175c-a2e6-402f-ac11-ac27f045a25b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:44.381310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96175c-a2e6-402f-ac11-ac27f045a25b None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:44.382018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96175c-a2e6-402f-ac11-ac27f045a25b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:44.383506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96175c-a2e6-402f-ac11-ac27f045a25b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:44.407681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 32/57] 10.222.0.44 () {60 vars in 1140 bytes} [Fri Jun 24 10:18:44 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:18:46.449921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679954b-cb2b-4794-ba5b-d5c46f484a84 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:46.450456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679954b-cb2b-4794-ba5b-d5c46f484a84 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:46.450537 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679954b-cb2b-4794-ba5b-d5c46f484a84 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:46.451898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 26/58] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:46.456958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee27eb-a3df-4092-8a23-efbc9f266e3f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:46.457369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee27eb-a3df-4092-8a23-efbc9f266e3f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:46.457524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee27eb-a3df-4092-8a23-efbc9f266e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:46.473827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6bee27eb-a3df-4092-8a23-efbc9f266e3f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:46.475046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6bee27eb-a3df-4092-8a23-efbc9f266e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:46.486363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:46.543554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 33/59] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:46.569261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679954b-cb2b-4794-ba5b-d5c46f484a84 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:46.668102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679954b-cb2b-4794-ba5b-d5c46f484a84 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:46.676893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:46.700961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62321008-5b4f-4098-ad12-7d83763e1c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:46.701684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62321008-5b4f-4098-ad12-7d83763e1c7b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:46.701968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62321008-5b4f-4098-ad12-7d83763e1c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:46.702245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62321008-5b4f-4098-ad12-7d83763e1c7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:46.705769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62321008-5b4f-4098-ad12-7d83763e1c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:46.707228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62321008-5b4f-4098-ad12-7d83763e1c7b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:46.708855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 27/60] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:18:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:46.714461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee27eb-a3df-4092-8a23-efbc9f266e3f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:46.810369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee27eb-a3df-4092-8a23-efbc9f266e3f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:46.842308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167cc95-6d9e-47b7-8ed7-717a1689e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:46.842995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167cc95-6d9e-47b7-8ed7-717a1689e7d1 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:46.843347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167cc95-6d9e-47b7-8ed7-717a1689e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:46.844116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167cc95-6d9e-47b7-8ed7-717a1689e7d1 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:46.844818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167cc95-6d9e-47b7-8ed7-717a1689e7d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:46.846260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167cc95-6d9e-47b7-8ed7-717a1689e7d1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:46.870599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 34/61] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:18:46 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:18:49.921731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2dd9a-e3fe-4d0d-a562-1fc192a6155e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:49.922725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2dd9a-e3fe-4d0d-a562-1fc192a6155e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:49.923242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2dd9a-e3fe-4d0d-a562-1fc192a6155e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:49.925082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 28/62] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:49.930909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f62a7-e3f9-45f0-8fe6-1778fcc160b5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:49.931723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f62a7-e3f9-45f0-8fe6-1778fcc160b5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:49.932207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f62a7-e3f9-45f0-8fe6-1778fcc160b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:49.940059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:49.953795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14379-b8b1-4987-b7fc-2d3e18d1ee9e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:49.953795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14379-b8b1-4987-b7fc-2d3e18d1ee9e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:49.953795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14379-b8b1-4987-b7fc-2d3e18d1ee9e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:49.953795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 29/63] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:49.956195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-038f62a7-e3f9-45f0-8fe6-1778fcc160b5 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:49.958537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-038f62a7-e3f9-45f0-8fe6-1778fcc160b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:49.961724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf0e79-73ae-41ec-8685-a4876268949d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:49.962277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf0e79-73ae-41ec-8685-a4876268949d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:49.962789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf0e79-73ae-41ec-8685-a4876268949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:49.989808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3adf0e79-73ae-41ec-8685-a4876268949d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:49.991033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3adf0e79-73ae-41ec-8685-a4876268949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:50.074937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 30/64] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:50.103937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 35/65] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:50.117881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf0e79-73ae-41ec-8685-a4876268949d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:50.134380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f62a7-e3f9-45f0-8fe6-1778fcc160b5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:50.232661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f62a7-e3f9-45f0-8fe6-1778fcc160b5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:50.234435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf0e79-73ae-41ec-8685-a4876268949d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:50.242297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:50.285307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20a972-0c46-40c7-855b-a451f1cb49a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:50.287223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a972-0c46-40c7-855b-a451f1cb49a5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.288340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a972-0c46-40c7-855b-a451f1cb49a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.288965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a972-0c46-40c7-855b-a451f1cb49a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.292997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:50.303686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5df12-d6fc-4b19-b2de-9cb040b4d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:50.304777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5df12-d6fc-4b19-b2de-9cb040b4d352 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.305277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5df12-d6fc-4b19-b2de-9cb040b4d352 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.305914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5df12-d6fc-4b19-b2de-9cb040b4d352 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.316392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20a972-0c46-40c7-855b-a451f1cb49a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-ef20a972-0c46-40c7-855b-a451f1cb49a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:50.326187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:50.328168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:18:50.330048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:18:50.331416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5df12-d6fc-4b19-b2de-9cb040b4d352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:50.334114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 31/66] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:50.335970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc913d-64c5-47fb-b426-472b41b5988e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.336439 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc913d-64c5-47fb-b426-472b41b5988e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.336892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc913d-64c5-47fb-b426-472b41b5988e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.338433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 32/67] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:50.340512 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc913d-64c5-47fb-b426-472b41b5988e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-87f5df12-d6fc-4b19-b2de-9cb040b4d352 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:50.344954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:50.346018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:50.346842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:18:50.349867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 36/68] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:50.351373 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5361823-2e18-4e6a-8df4-1ba01e25afc9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.351857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5361823-2e18-4e6a-8df4-1ba01e25afc9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.352328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5361823-2e18-4e6a-8df4-1ba01e25afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.376478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f5361823-2e18-4e6a-8df4-1ba01e25afc9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:50.377688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f5361823-2e18-4e6a-8df4-1ba01e25afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:50.457573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 37/69] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:50.458591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5361823-2e18-4e6a-8df4-1ba01e25afc9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:50.459265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc913d-64c5-47fb-b426-472b41b5988e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:50.494590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e7562-77d4-4a08-a6ae-123c657641aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:50.495581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e7562-77d4-4a08-a6ae-123c657641aa None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.496068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e7562-77d4-4a08-a6ae-123c657641aa None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.496696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e7562-77d4-4a08-a6ae-123c657641aa None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.497496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e7562-77d4-4a08-a6ae-123c657641aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:50.497821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e7562-77d4-4a08-a6ae-123c657641aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:50.499328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e7562-77d4-4a08-a6ae-123c657641aa None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:50.508303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 33/70] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:18:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:50.509678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e536-9072-4f8d-8956-4cbcc1d39b4b None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.509979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e536-9072-4f8d-8956-4cbcc1d39b4b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.510260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e536-9072-4f8d-8956-4cbcc1d39b4b None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.511657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 34/71] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:50.516123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6e536-9072-4f8d-8956-4cbcc1d39b4b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:50.546907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:50.587102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5361823-2e18-4e6a-8df4-1ba01e25afc9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:50.611428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:50.624801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc14c1-1826-40cf-99cc-c6d6e455b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:50.625511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc14c1-1826-40cf-99cc-c6d6e455b98c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.625800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc14c1-1826-40cf-99cc-c6d6e455b98c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.626084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc14c1-1826-40cf-99cc-c6d6e455b98c None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.626876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc14c1-1826-40cf-99cc-c6d6e455b98c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:50.627192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc14c1-1826-40cf-99cc-c6d6e455b98c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:50.628605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc14c1-1826-40cf-99cc-c6d6e455b98c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:50.632120 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6e536-9072-4f8d-8956-4cbcc1d39b4b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:50.642300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 38/72] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:50.642300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc14c1-1826-40cf-99cc-c6d6e455b98c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:50.673406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a90da5-83da-4a8d-9f47-62c693674463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:50.674567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a90da5-83da-4a8d-9f47-62c693674463 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.675134 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a90da5-83da-4a8d-9f47-62c693674463 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.675426 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a90da5-83da-4a8d-9f47-62c693674463 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.689216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a90da5-83da-4a8d-9f47-62c693674463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a8a90da5-83da-4a8d-9f47-62c693674463 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:50.699559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:50.700386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:18:50.701140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 35/73] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:18:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:50.703010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26084f09-f1c6-4898-96e3-2e6b08ceda2e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.703315 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26084f09-f1c6-4898-96e3-2e6b08ceda2e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.703599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26084f09-f1c6-4898-96e3-2e6b08ceda2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.722457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-26084f09-f1c6-4898-96e3-2e6b08ceda2e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:50.723734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-26084f09-f1c6-4898-96e3-2e6b08ceda2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:50.752118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc14c1-1826-40cf-99cc-c6d6e455b98c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:50.787934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea729e-4517-4c80-ba1f-1d5e31962265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:50.788812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea729e-4517-4c80-ba1f-1d5e31962265 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.789103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea729e-4517-4c80-ba1f-1d5e31962265 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.789391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea729e-4517-4c80-ba1f-1d5e31962265 None admin] PATH_INFO: `/v3/users/69c62b93d65347deb4a3134278885674` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.793718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 36/74] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:50.794526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26084f09-f1c6-4898-96e3-2e6b08ceda2e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:50.802968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea729e-4517-4c80-ba1f-1d5e31962265 None admin] RBAC: Authorizing `identity:get_user(user_id=69c62b93d65347deb4a3134278885674)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:50.804431 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea729e-4517-4c80-ba1f-1d5e31962265 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:50.806238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 39/75] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:50 2022] GET /identity/v3/users/69c62b93d65347deb4a3134278885674 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:50.806898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea729e-4517-4c80-ba1f-1d5e31962265 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:50.822323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:50.850027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:50.904375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26084f09-f1c6-4898-96e3-2e6b08ceda2e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:50.906740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea729e-4517-4c80-ba1f-1d5e31962265 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:50.938799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0424-3dbc-41f3-aee3-9af38bc46e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:50.939665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0424-3dbc-41f3-aee3-9af38bc46e4d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.939955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0424-3dbc-41f3-aee3-9af38bc46e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.940233 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0424-3dbc-41f3-aee3-9af38bc46e4d None admin] PATH_INFO: `/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.940319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d81e46-e52a-4571-b4f5-66c5ed05f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:50.940943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d81e46-e52a-4571-b4f5-66c5ed05f720 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.941230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d81e46-e52a-4571-b4f5-66c5ed05f720 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.941428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e0424-3dbc-41f3-aee3-9af38bc46e4d None admin] RBAC: Authorizing `identity:get_user(user_id=7e9b1eea1bc44e2ab2c9802f041f72c3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:50.941513 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d81e46-e52a-4571-b4f5-66c5ed05f720 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.942245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d81e46-e52a-4571-b4f5-66c5ed05f720 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:50.942588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d81e46-e52a-4571-b4f5-66c5ed05f720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:50.942906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e0424-3dbc-41f3-aee3-9af38bc46e4d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:50.943938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d81e46-e52a-4571-b4f5-66c5ed05f720 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:50.944540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 37/76] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:50 2022] GET /identity/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:50.945755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2ce37-9e6b-432f-93e3-de733c1c0aa6 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:50.946055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2ce37-9e6b-432f-93e3-de733c1c0aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:50.946334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2ce37-9e6b-432f-93e3-de733c1c0aa6 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:50.947594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 38/77] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:50.951167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2ce37-9e6b-432f-93e3-de733c1c0aa6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:50.953238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 40/78] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:18:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:50.953935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d81e46-e52a-4571-b4f5-66c5ed05f720 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:51.037406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:51.055063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2ce37-9e6b-432f-93e3-de733c1c0aa6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:51.064389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d81e46-e52a-4571-b4f5-66c5ed05f720 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:51.067416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:51.088472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4623e-7c35-4263-8c50-5711d8b593b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:51.089114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4623e-7c35-4263-8c50-5711d8b593b3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.089401 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4623e-7c35-4263-8c50-5711d8b593b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.089678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4623e-7c35-4263-8c50-5711d8b593b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.100457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabb17-0739-4cf3-b1bb-aca3bb23466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:51.101241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabb17-0739-4cf3-b1bb-aca3bb23466e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.101533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabb17-0739-4cf3-b1bb-aca3bb23466e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.101816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabb17-0739-4cf3-b1bb-aca3bb23466e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.111824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eabb17-0739-4cf3-b1bb-aca3bb23466e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-74eabb17-0739-4cf3-b1bb-aca3bb23466e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:51.119369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:51.120496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 41/79] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:51.121584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabb17-0739-4cf3-b1bb-aca3bb23466e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:51.159969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4623e-7c35-4263-8c50-5711d8b593b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:51.161441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4623e-7c35-4263-8c50-5711d8b593b3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:51.223657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabb17-0739-4cf3-b1bb-aca3bb23466e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:51.243975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:51.256658 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e9bea-fc0b-43ff-b2c5-0b722b42955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:51.257316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9bea-fc0b-43ff-b2c5-0b722b42955f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.257621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9bea-fc0b-43ff-b2c5-0b722b42955f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.257901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9bea-fc0b-43ff-b2c5-0b722b42955f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.260466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 39/80] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:51.261726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581940cb-213d-43cb-88f7-f6e9fbac9e04 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.262028 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581940cb-213d-43cb-88f7-f6e9fbac9e04 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.262310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581940cb-213d-43cb-88f7-f6e9fbac9e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.278942 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-581940cb-213d-43cb-88f7-f6e9fbac9e04 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:51.280162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-581940cb-213d-43cb-88f7-f6e9fbac9e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:51.295761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:51.333348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e9bea-fc0b-43ff-b2c5-0b722b42955f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:51.334871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e9bea-fc0b-43ff-b2c5-0b722b42955f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:51.347264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 40/81] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:51.348113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581940cb-213d-43cb-88f7-f6e9fbac9e04 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:51.443013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 42/82] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:51.443871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e9bea-fc0b-43ff-b2c5-0b722b42955f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:51.447201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581940cb-213d-43cb-88f7-f6e9fbac9e04 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:51.463786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:51.483111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141ce92-d2a8-456f-be8c-73ab4f363d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:51.484623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141ce92-d2a8-456f-be8c-73ab4f363d00 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.484909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141ce92-d2a8-456f-be8c-73ab4f363d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.485191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141ce92-d2a8-456f-be8c-73ab4f363d00 None admin] PATH_INFO: `/v3/users/69c62b93d65347deb4a3134278885674` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.486447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141ce92-d2a8-456f-be8c-73ab4f363d00 None admin] RBAC: Authorizing `identity:get_user(user_id=69c62b93d65347deb4a3134278885674)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:51.487896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141ce92-d2a8-456f-be8c-73ab4f363d00 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:51.489544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 41/83] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:51 2022] GET /identity/v3/users/69c62b93d65347deb4a3134278885674 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:51.490318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141ce92-d2a8-456f-be8c-73ab4f363d00 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:51.509614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:51.548208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e9bea-fc0b-43ff-b2c5-0b722b42955f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:51.583676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e58eb0-bee6-4cf2-b5bf-e0e9d8d889be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:51.584351 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e58eb0-bee6-4cf2-b5bf-e0e9d8d889be None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.584646 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e58eb0-bee6-4cf2-b5bf-e0e9d8d889be None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.584925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e58eb0-bee6-4cf2-b5bf-e0e9d8d889be None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.585681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e58eb0-bee6-4cf2-b5bf-e0e9d8d889be None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:51.585991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e58eb0-bee6-4cf2-b5bf-e0e9d8d889be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:51.587422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e58eb0-bee6-4cf2-b5bf-e0e9d8d889be None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:51.590220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141ce92-d2a8-456f-be8c-73ab4f363d00 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:51.597293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 43/84] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:18:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:51.598106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e58eb0-bee6-4cf2-b5bf-e0e9d8d889be None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:51.629476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b734-29b2-4a8a-9e48-975a7b0c162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:51.630343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b734-29b2-4a8a-9e48-975a7b0c162c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.630661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b734-29b2-4a8a-9e48-975a7b0c162c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.630939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b734-29b2-4a8a-9e48-975a7b0c162c None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.632123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60b734-29b2-4a8a-9e48-975a7b0c162c None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:51.633551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60b734-29b2-4a8a-9e48-975a7b0c162c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:51.635283 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 42/85] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:18:51 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:51.636056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b734-29b2-4a8a-9e48-975a7b0c162c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:51.691012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:51.696811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e58eb0-bee6-4cf2-b5bf-e0e9d8d889be None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:51.722116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:51.731235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54144ffa-d597-4d31-bcac-ec97cc977831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:51.732021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54144ffa-d597-4d31-bcac-ec97cc977831 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.732305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54144ffa-d597-4d31-bcac-ec97cc977831 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.732583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54144ffa-d597-4d31-bcac-ec97cc977831 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.734281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54144ffa-d597-4d31-bcac-ec97cc977831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:51.735752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54144ffa-d597-4d31-bcac-ec97cc977831 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:51.737355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 44/86] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:18:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:51.738020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b734-29b2-4a8a-9e48-975a7b0c162c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:51.738136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54144ffa-d597-4d31-bcac-ec97cc977831 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:51.772014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3274556-c6f2-49bd-8148-df2db4d8867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:51.772873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3274556-c6f2-49bd-8148-df2db4d8867a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.773158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3274556-c6f2-49bd-8148-df2db4d8867a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.773438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3274556-c6f2-49bd-8148-df2db4d8867a None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.774637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3274556-c6f2-49bd-8148-df2db4d8867a None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:51.776081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3274556-c6f2-49bd-8148-df2db4d8867a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:51.777862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 43/87] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:18:51 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:51.778644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3274556-c6f2-49bd-8148-df2db4d8867a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:51.841874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54144ffa-d597-4d31-bcac-ec97cc977831 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:51.875180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112c255-60ba-48ff-9e78-f90516a68b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:51.875833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112c255-60ba-48ff-9e78-f90516a68b81 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.875946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3274556-c6f2-49bd-8148-df2db4d8867a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:51.876124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112c255-60ba-48ff-9e78-f90516a68b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.876408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112c255-60ba-48ff-9e78-f90516a68b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.895983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:51.910798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c567a-d16e-4932-944e-6b0d5ce60aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:51.911663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c567a-d16e-4932-944e-6b0d5ce60aaf None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:51.911976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c567a-d16e-4932-944e-6b0d5ce60aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:51.912256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c567a-d16e-4932-944e-6b0d5ce60aaf None admin] PATH_INFO: `/v3/users/69c62b93d65347deb4a3134278885674` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:51.913441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c567a-d16e-4932-944e-6b0d5ce60aaf None admin] RBAC: Authorizing `identity:get_user(user_id=69c62b93d65347deb4a3134278885674)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:51.914926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c567a-d16e-4932-944e-6b0d5ce60aaf None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:51.916853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 44/88] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:51 2022] GET /identity/v3/users/69c62b93d65347deb4a3134278885674 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:51.917516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c567a-d16e-4932-944e-6b0d5ce60aaf None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:51.937473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:51.945578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112c255-60ba-48ff-9e78-f90516a68b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:51.947310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112c255-60ba-48ff-9e78-f90516a68b81 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:52.013726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c567a-d16e-4932-944e-6b0d5ce60aaf None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:52.047585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 45/89] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:52.047740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6d2a3-b164-4f1f-bd4f-7813aad1dbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:52.048184 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6d2a3-b164-4f1f-bd4f-7813aad1dbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:52.048282 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112c255-60ba-48ff-9e78-f90516a68b81 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:52.048532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6d2a3-b164-4f1f-bd4f-7813aad1dbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:52.048813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6d2a3-b164-4f1f-bd4f-7813aad1dbb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:52.049640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6d2a3-b164-4f1f-bd4f-7813aad1dbb8 None admin] RBAC: Adding query filter params (role.id=6c516ab551054fc8bd24c92c7d9173ba, scope.project.id=0de6538741964c2b8766be7436e4800e, user.id=69c62b93d65347deb4a3134278885674) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:52.049950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6d2a3-b164-4f1f-bd4f-7813aad1dbb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:52.051422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6d2a3-b164-4f1f-bd4f-7813aad1dbb8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:52.059545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 45/90] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:18:51 2022] GET /identity/v3/role_assignments?user.id=69c62b93d65347deb4a3134278885674&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:52.060338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6d2a3-b164-4f1f-bd4f-7813aad1dbb8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:52.119182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:52.172569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6d2a3-b164-4f1f-bd4f-7813aad1dbb8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:52.177729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:52.186556 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112c255-60ba-48ff-9e78-f90516a68b81 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:52.216969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2f22-70f9-4f63-adea-796141350c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:52.217631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2f22-70f9-4f63-adea-796141350c98 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:52.217950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2f22-70f9-4f63-adea-796141350c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:52.218234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2f22-70f9-4f63-adea-796141350c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:52.219108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2f22-70f9-4f63-adea-796141350c98 None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=0de6538741964c2b8766be7436e4800e, user.id=7e9b1eea1bc44e2ab2c9802f041f72c3) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:52.219426 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2f22-70f9-4f63-adea-796141350c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:52.222393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2f22-70f9-4f63-adea-796141350c98 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:52.238490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 46/91] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:18:52 2022] GET /identity/v3/role_assignments?user.id=7e9b1eea1bc44e2ab2c9802f041f72c3&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:52.238490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2f22-70f9-4f63-adea-796141350c98 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:52.241221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca99c-527c-4789-bfa6-c8ef8457fd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:52.242263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca99c-527c-4789-bfa6-c8ef8457fd57 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:52.242636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca99c-527c-4789-bfa6-c8ef8457fd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:52.242978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca99c-527c-4789-bfa6-c8ef8457fd57 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:52.244079 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca99c-527c-4789-bfa6-c8ef8457fd57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:52.246595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca99c-527c-4789-bfa6-c8ef8457fd57 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:52.277240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 46/92] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:18:52 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:18:52.278283 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca99c-527c-4789-bfa6-c8ef8457fd57 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:52.401824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2f22-70f9-4f63-adea-796141350c98 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:52.422321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:52.448030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acb20a-5ee3-4fae-9131-9210e61eea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:52.448748 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acb20a-5ee3-4fae-9131-9210e61eea99 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:52.449040 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acb20a-5ee3-4fae-9131-9210e61eea99 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:52.449330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acb20a-5ee3-4fae-9131-9210e61eea99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:52.501343 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca99c-527c-4789-bfa6-c8ef8457fd57 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:52.529438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acb20a-5ee3-4fae-9131-9210e61eea99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:52.531362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acb20a-5ee3-4fae-9131-9210e61eea99 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:52.540477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bed9b-c876-454d-a357-174e8716f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:52.541710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bed9b-c876-454d-a357-174e8716f87f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:52.542397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bed9b-c876-454d-a357-174e8716f87f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:52.542871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bed9b-c876-454d-a357-174e8716f87f None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:52.544327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bed9b-c876-454d-a357-174e8716f87f None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:52.547585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bed9b-c876-454d-a357-174e8716f87f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:52.549700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 47/93] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:18:52 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:52.558505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bed9b-c876-454d-a357-174e8716f87f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:52.588316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:52.679518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 47/94] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:18:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:52.684912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acb20a-5ee3-4fae-9131-9210e61eea99 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:52.703874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:52.715487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bed9b-c876-454d-a357-174e8716f87f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:52.769766 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73559751-18f7-419c-8b54-ae8bd7afde89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:52.770472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73559751-18f7-419c-8b54-ae8bd7afde89 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:52.770768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73559751-18f7-419c-8b54-ae8bd7afde89 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:52.771054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73559751-18f7-419c-8b54-ae8bd7afde89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:52.771969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73559751-18f7-419c-8b54-ae8bd7afde89 None admin] RBAC: Adding query filter params (role.id=d3f29bc0265f45979298aa97cf42ee59, scope.project.id=0de6538741964c2b8766be7436e4800e, user.id=69c62b93d65347deb4a3134278885674) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:52.772551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73559751-18f7-419c-8b54-ae8bd7afde89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:52.773709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73559751-18f7-419c-8b54-ae8bd7afde89 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:52.780346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 48/95] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:18:52 2022] GET /identity/v3/role_assignments?user.id=69c62b93d65347deb4a3134278885674&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=d3f29bc0265f45979298aa97cf42ee59 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:52.824607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acb20a-5ee3-4fae-9131-9210e61eea99 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:52.866725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5dc11-2525-4a54-a2b4-eebb98d32396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:52.867970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5dc11-2525-4a54-a2b4-eebb98d32396 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:52.868457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5dc11-2525-4a54-a2b4-eebb98d32396 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:52.868935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5dc11-2525-4a54-a2b4-eebb98d32396 None admin] PATH_INFO: `/v3/projects/48ae805724e640728c652e5cc574c836` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:52.870498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5dc11-2525-4a54-a2b4-eebb98d32396 None admin] RBAC: Authorizing `identity:get_project(project_id=48ae805724e640728c652e5cc574c836)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:52.872292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5dc11-2525-4a54-a2b4-eebb98d32396 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:52.875302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 48/96] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:18:52 2022] GET /identity/v3/projects/48ae805724e640728c652e5cc574c836 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:52.883546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73559751-18f7-419c-8b54-ae8bd7afde89 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:52.977898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:52.998606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73559751-18f7-419c-8b54-ae8bd7afde89 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:53.034140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b114d-3894-4f3e-a8f0-78e35e2adb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:53.034840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b114d-3894-4f3e-a8f0-78e35e2adb17 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:53.035123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b114d-3894-4f3e-a8f0-78e35e2adb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:53.035409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b114d-3894-4f3e-a8f0-78e35e2adb17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:53.036261 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b114d-3894-4f3e-a8f0-78e35e2adb17 None admin] RBAC: Adding query filter params (role.id=6c516ab551054fc8bd24c92c7d9173ba, scope.project.id=48ae805724e640728c652e5cc574c836, user.id=69c62b93d65347deb4a3134278885674) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:53.036580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b114d-3894-4f3e-a8f0-78e35e2adb17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:53.038027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b114d-3894-4f3e-a8f0-78e35e2adb17 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:53.044110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 49/97] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:18:52 2022] GET /identity/v3/role_assignments?user.id=69c62b93d65347deb4a3134278885674&scope.project.id=48ae805724e640728c652e5cc574c836&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:54.360693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dddb85-d964-42b5-88db-998f0ce22e3d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:54.361225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dddb85-d964-42b5-88db-998f0ce22e3d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:54.361302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dddb85-d964-42b5-88db-998f0ce22e3d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:54.362673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 49/98] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:54.368147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582ace-b359-4dcc-9ae5-63e4c7e8fa39 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:54.368948 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582ace-b359-4dcc-9ae5-63e4c7e8fa39 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:54.369446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582ace-b359-4dcc-9ae5-63e4c7e8fa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:54.387965 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-80582ace-b359-4dcc-9ae5-63e4c7e8fa39 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:54.389471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-80582ace-b359-4dcc-9ae5-63e4c7e8fa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:54.480542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 50/99] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:18:54.505455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dddb85-d964-42b5-88db-998f0ce22e3d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:54.602524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:54.621456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dddb85-d964-42b5-88db-998f0ce22e3d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:54.662222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b690429-26cc-4bb8-9744-f97f73ef3e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:54.663054 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690429-26cc-4bb8-9744-f97f73ef3e1c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:54.663348 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690429-26cc-4bb8-9744-f97f73ef3e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:54.663628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690429-26cc-4bb8-9744-f97f73ef3e1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:54.675206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b690429-26cc-4bb8-9744-f97f73ef3e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4b690429-26cc-4bb8-9744-f97f73ef3e1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:54.683197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:54.684056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:18:54.684828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 50/100] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:54.690746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80582ace-b359-4dcc-9ae5-63e4c7e8fa39 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:54.788983 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:54.818534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80582ace-b359-4dcc-9ae5-63e4c7e8fa39 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:54.866200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c05ca-62a8-4db9-9065-12ae5c50c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:54.866921 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c05ca-62a8-4db9-9065-12ae5c50c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:54.867212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c05ca-62a8-4db9-9065-12ae5c50c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:54.867487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c05ca-62a8-4db9-9065-12ae5c50c9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:54.868258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c05ca-62a8-4db9-9065-12ae5c50c9a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:54.868569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c05ca-62a8-4db9-9065-12ae5c50c9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:54.869961 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c05ca-62a8-4db9-9065-12ae5c50c9a3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:54.879256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 51/101] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:18:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:54.884792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b690429-26cc-4bb8-9744-f97f73ef3e1c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:54.993896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b690429-26cc-4bb8-9744-f97f73ef3e1c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:55.028934 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6965683-9866-48ec-9c3b-a5b9de035c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:55.029825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965683-9866-48ec-9c3b-a5b9de035c04 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:55.030164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965683-9866-48ec-9c3b-a5b9de035c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:55.030982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965683-9866-48ec-9c3b-a5b9de035c04 None admin] PATH_INFO: `/v3/users/69c62b93d65347deb4a3134278885674` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:55.032213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6965683-9866-48ec-9c3b-a5b9de035c04 None admin] RBAC: Authorizing `identity:get_user(user_id=69c62b93d65347deb4a3134278885674)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:55.033673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6965683-9866-48ec-9c3b-a5b9de035c04 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:55.035351 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 51/102] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:54 2022] GET /identity/v3/users/69c62b93d65347deb4a3134278885674 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:55.040962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c05ca-62a8-4db9-9065-12ae5c50c9a3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:55.179733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47688b12-911d-47fe-9778-f1151aa89ae4 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:55.180139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47688b12-911d-47fe-9778-f1151aa89ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:55.180458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47688b12-911d-47fe-9778-f1151aa89ae4 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:55.182040 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 52/103] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:55.187760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8422-f7a0-4eb5-8f3f-201efbc61624 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:55.187984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c05ca-62a8-4db9-9065-12ae5c50c9a3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:55.188081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8422-f7a0-4eb5-8f3f-201efbc61624 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:55.188323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8422-f7a0-4eb5-8f3f-201efbc61624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:55.213035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2f0d8422-f7a0-4eb5-8f3f-201efbc61624 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:55.214235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2f0d8422-f7a0-4eb5-8f3f-201efbc61624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:55.223955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:55.258702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4bcb4-024e-4316-8f68-b0be1fea8b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:55.259561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4bcb4-024e-4316-8f68-b0be1fea8b01 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:55.259846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4bcb4-024e-4316-8f68-b0be1fea8b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:55.260122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4bcb4-024e-4316-8f68-b0be1fea8b01 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:55.261978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4bcb4-024e-4316-8f68-b0be1fea8b01 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:55.263472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4bcb4-024e-4316-8f68-b0be1fea8b01 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:55.265746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 52/104] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:18:55 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:55.272332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4bcb4-024e-4316-8f68-b0be1fea8b01 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:55.302684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:55.340558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 53/105] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:18:55.385486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8422-f7a0-4eb5-8f3f-201efbc61624 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:55.449788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4bcb4-024e-4316-8f68-b0be1fea8b01 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:55.518864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23252933-a04d-4a2f-8ca1-b235568143b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:55.519760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252933-a04d-4a2f-8ca1-b235568143b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:55.520047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252933-a04d-4a2f-8ca1-b235568143b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:55.520325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252933-a04d-4a2f-8ca1-b235568143b5 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e/users/69c62b93d65347deb4a3134278885674/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:55.523554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23252933-a04d-4a2f-8ca1-b235568143b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0de6538741964c2b8766be7436e4800e, user_id=69c62b93d65347deb4a3134278885674, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:55.525031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23252933-a04d-4a2f-8ca1-b235568143b5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:55.539495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8422-f7a0-4eb5-8f3f-201efbc61624 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:55.554146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 53/106] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:18:55 2022] PUT /identity/v3/projects/0de6538741964c2b8766be7436e4800e/users/69c62b93d65347deb4a3134278885674/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:18:55.598240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f12b-e283-4bdb-a46b-29337e998adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:55.599175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f12b-e283-4bdb-a46b-29337e998adb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:55.599463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f12b-e283-4bdb-a46b-29337e998adb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:55.599745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f12b-e283-4bdb-a46b-29337e998adb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:55.617666 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5f12b-e283-4bdb-a46b-29337e998adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a0d5f12b-e283-4bdb-a46b-29337e998adb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:55.625661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:55.626678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:55.627443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:18:55.631899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 54/107] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:18:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:55.633353 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23252933-a04d-4a2f-8ca1-b235568143b5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:55.705426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:55.742343 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23252933-a04d-4a2f-8ca1-b235568143b5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:55.779003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28274129-7ecf-48eb-ad7b-d89716827bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:55.779680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28274129-7ecf-48eb-ad7b-d89716827bce None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:55.779965 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28274129-7ecf-48eb-ad7b-d89716827bce None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:55.780797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28274129-7ecf-48eb-ad7b-d89716827bce None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:55.781563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28274129-7ecf-48eb-ad7b-d89716827bce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:55.781876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28274129-7ecf-48eb-ad7b-d89716827bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:55.783487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28274129-7ecf-48eb-ad7b-d89716827bce None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:55.792762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 54/108] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:55.798651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f12b-e283-4bdb-a46b-29337e998adb None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:55.801534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:55.941986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f12b-e283-4bdb-a46b-29337e998adb None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:55.947700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb7bb1-adfb-4aa8-9989-d6cde450a547 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:55.947994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb7bb1-adfb-4aa8-9989-d6cde450a547 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:55.948275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb7bb1-adfb-4aa8-9989-d6cde450a547 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:55.949663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 55/109] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:55.958952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bf408-986e-4c5c-bbf7-2472751850ae None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:55.959240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bf408-986e-4c5c-bbf7-2472751850ae None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:55.959442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bf408-986e-4c5c-bbf7-2472751850ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:55.987587 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4e3bf408-986e-4c5c-bbf7-2472751850ae None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:55.989157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4e3bf408-986e-4c5c-bbf7-2472751850ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:56.007513 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89b792-9bb0-4c07-b433-85b005041b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:56.008407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89b792-9bb0-4c07-b433-85b005041b5d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.008697 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89b792-9bb0-4c07-b433-85b005041b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.008975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89b792-9bb0-4c07-b433-85b005041b5d None admin] PATH_INFO: `/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.011832 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89b792-9bb0-4c07-b433-85b005041b5d None admin] RBAC: Authorizing `identity:get_user(user_id=7e9b1eea1bc44e2ab2c9802f041f72c3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:56.013299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89b792-9bb0-4c07-b433-85b005041b5d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:56.015645 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 55/110] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:55 2022] GET /identity/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:56.017378 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5bb0e-cec2-4478-b24a-55a1a4a097ec None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.017666 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5bb0e-cec2-4478-b24a-55a1a4a097ec None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.017949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5bb0e-cec2-4478-b24a-55a1a4a097ec None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.019430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 56/111] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:56.025151 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5bb0e-cec2-4478-b24a-55a1a4a097ec None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:56.105265 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 56/112] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:18:56.106624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571eb0-ffe1-439d-a7e3-e344520627c2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.106962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571eb0-ffe1-439d-a7e3-e344520627c2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.107254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571eb0-ffe1-439d-a7e3-e344520627c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.132175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4a571eb0-ffe1-439d-a7e3-e344520627c2 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:56.133433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4a571eb0-ffe1-439d-a7e3-e344520627c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:56.144209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:56.186708 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5bb0e-cec2-4478-b24a-55a1a4a097ec None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:56.204554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:56.225457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 57/113] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:56.230381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6d63-76f6-4e65-8c9a-dba50e5dacb7 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.230381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6d63-76f6-4e65-8c9a-dba50e5dacb7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.230381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6d63-76f6-4e65-8c9a-dba50e5dacb7 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.230381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 58/114] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:56.235398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff6d63-76f6-4e65-8c9a-dba50e5dacb7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:56.252518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3f1fa-ce60-4a69-b2a5-6b5809959161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:56.253478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f1fa-ce60-4a69-b2a5-6b5809959161 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.253768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f1fa-ce60-4a69-b2a5-6b5809959161 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.254050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f1fa-ce60-4a69-b2a5-6b5809959161 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.255452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3f1fa-ce60-4a69-b2a5-6b5809959161 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:56.258984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3f1fa-ce60-4a69-b2a5-6b5809959161 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:56.263218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 57/115] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:18:56 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:56.265045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0332d8-c78a-4e13-99e4-211c328cee9e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.266113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0332d8-c78a-4e13-99e4-211c328cee9e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.266432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0332d8-c78a-4e13-99e4-211c328cee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.290459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-eb0332d8-c78a-4e13-99e4-211c328cee9e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:56.291996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-eb0332d8-c78a-4e13-99e4-211c328cee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:56.370482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff6d63-76f6-4e65-8c9a-dba50e5dacb7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:56.376750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 58/116] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:56.377901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0332d8-c78a-4e13-99e4-211c328cee9e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:56.421451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468f82e-1327-41a2-ae01-d6a38a983346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:56.422580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468f82e-1327-41a2-ae01-d6a38a983346 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.422875 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468f82e-1327-41a2-ae01-d6a38a983346 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.423165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468f82e-1327-41a2-ae01-d6a38a983346 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.437611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468f82e-1327-41a2-ae01-d6a38a983346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c468f82e-1327-41a2-ae01-d6a38a983346 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:56.447536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:56.448609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 59/117] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:56.449539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468f82e-1327-41a2-ae01-d6a38a983346 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:56.476990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:56.504362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:56.514145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0332d8-c78a-4e13-99e4-211c328cee9e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:56.552567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fedb58-ffe0-4090-b092-c36b6718cdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:56.553406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fedb58-ffe0-4090-b092-c36b6718cdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.553681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fedb58-ffe0-4090-b092-c36b6718cdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.553967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fedb58-ffe0-4090-b092-c36b6718cdf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.561871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468f82e-1327-41a2-ae01-d6a38a983346 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:56.568619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fedb58-ffe0-4090-b092-c36b6718cdf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-c7fedb58-ffe0-4090-b092-c36b6718cdf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:56.578003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:56.578902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 59/118] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:18:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:56.585170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fedb58-ffe0-4090-b092-c36b6718cdf2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:56.607369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62074e4f-162c-4ee7-bdde-fbe46fff82a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:56.608297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074e4f-162c-4ee7-bdde-fbe46fff82a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.608581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074e4f-162c-4ee7-bdde-fbe46fff82a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.608863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074e4f-162c-4ee7-bdde-fbe46fff82a2 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e/users/7e9b1eea1bc44e2ab2c9802f041f72c3/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.611301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62074e4f-162c-4ee7-bdde-fbe46fff82a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0de6538741964c2b8766be7436e4800e, user_id=7e9b1eea1bc44e2ab2c9802f041f72c3, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:56.612801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62074e4f-162c-4ee7-bdde-fbe46fff82a2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:56.627950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 60/119] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:18:56 2022] PUT /identity/v3/projects/0de6538741964c2b8766be7436e4800e/users/7e9b1eea1bc44e2ab2c9802f041f72c3/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:18:56.629573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d494cc-645c-427d-aa1d-d43c457ead44 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.629941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d494cc-645c-427d-aa1d-d43c457ead44 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.630317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d494cc-645c-427d-aa1d-d43c457ead44 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.631801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 61/120] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:56.632630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d494cc-645c-427d-aa1d-d43c457ead44 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:56.721472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fedb58-ffe0-4090-b092-c36b6718cdf2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:56.752651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d494cc-645c-427d-aa1d-d43c457ead44 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:56.754146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:56.763055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:56.765417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e64c8e-8473-4e27-a392-470195ebc221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:56.768073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64c8e-8473-4e27-a392-470195ebc221 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.768614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64c8e-8473-4e27-a392-470195ebc221 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.769089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64c8e-8473-4e27-a392-470195ebc221 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.770934 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e64c8e-8473-4e27-a392-470195ebc221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:56.772815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e64c8e-8473-4e27-a392-470195ebc221 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:56.774716 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 60/121] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:18:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:56.776722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e64c8e-8473-4e27-a392-470195ebc221 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:56.793816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493b5f-a4de-4423-a08f-cdce17a2261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:56.794621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493b5f-a4de-4423-a08f-cdce17a2261b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.794917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493b5f-a4de-4423-a08f-cdce17a2261b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.795382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493b5f-a4de-4423-a08f-cdce17a2261b None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.796820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5493b5f-a4de-4423-a08f-cdce17a2261b None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:56.797142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5493b5f-a4de-4423-a08f-cdce17a2261b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:56.798724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5493b5f-a4de-4423-a08f-cdce17a2261b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:56.808858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 62/122] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:18:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:56.810074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19705e-df56-4cee-983a-8f14d20ff0a6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.810480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19705e-df56-4cee-983a-8f14d20ff0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.810684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19705e-df56-4cee-983a-8f14d20ff0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.827668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ac19705e-df56-4cee-983a-8f14d20ff0a6 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:56.828911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ac19705e-df56-4cee-983a-8f14d20ff0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:56.900420 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 63/123] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:56.901267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19705e-df56-4cee-983a-8f14d20ff0a6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:56.914926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e64c8e-8473-4e27-a392-470195ebc221 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:56.955589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce06e6-9732-42a0-bb82-a575b3f7105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:56.956268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce06e6-9732-42a0-bb82-a575b3f7105a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:56.956622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce06e6-9732-42a0-bb82-a575b3f7105a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:56.957013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce06e6-9732-42a0-bb82-a575b3f7105a None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:56.957880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce06e6-9732-42a0-bb82-a575b3f7105a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:56.958204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce06e6-9732-42a0-bb82-a575b3f7105a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:56.959786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce06e6-9732-42a0-bb82-a575b3f7105a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:56.970815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 61/124] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:18:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:56.971725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce06e6-9732-42a0-bb82-a575b3f7105a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:57.038609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:57.042070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:57.043098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19705e-df56-4cee-983a-8f14d20ff0a6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:57.084957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce06e6-9732-42a0-bb82-a575b3f7105a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:57.091201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b8993-c2fd-4430-9d07-d8712db3d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:57.091890 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b8993-c2fd-4430-9d07-d8712db3d1f6 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:57.093141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b8993-c2fd-4430-9d07-d8712db3d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:57.093446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b8993-c2fd-4430-9d07-d8712db3d1f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:57.094173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b8993-c2fd-4430-9d07-d8712db3d1f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:57.096089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b8993-c2fd-4430-9d07-d8712db3d1f6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:57.125555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157486e5-2ba0-4622-801e-84af3f8d9c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:57.126468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157486e5-2ba0-4622-801e-84af3f8d9c92 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:57.126756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157486e5-2ba0-4622-801e-84af3f8d9c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:57.127035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157486e5-2ba0-4622-801e-84af3f8d9c92 None admin] PATH_INFO: `/v3/users/69c62b93d65347deb4a3134278885674` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:57.128244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157486e5-2ba0-4622-801e-84af3f8d9c92 None admin] RBAC: Authorizing `identity:get_user(user_id=69c62b93d65347deb4a3134278885674)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:57.129685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157486e5-2ba0-4622-801e-84af3f8d9c92 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:57.130758 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 64/125] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:18:56 2022] POST /identity/v3/projects => generated 302 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:18:57.131486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 62/126] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:56 2022] GET /identity/v3/users/69c62b93d65347deb4a3134278885674 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:57.131794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b8993-c2fd-4430-9d07-d8712db3d1f6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:57.132498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157486e5-2ba0-4622-801e-84af3f8d9c92 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:57.254217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157486e5-2ba0-4622-801e-84af3f8d9c92 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:57.273736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b8993-c2fd-4430-9d07-d8712db3d1f6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:57.290839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:57.315418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7ac6c-27d5-4874-96ff-0435318a60a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:57.316317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ac6c-27d5-4874-96ff-0435318a60a6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:57.316603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ac6c-27d5-4874-96ff-0435318a60a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:57.316880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ac6c-27d5-4874-96ff-0435318a60a6 None admin] PATH_INFO: `/v3/users/69c62b93d65347deb4a3134278885674` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:57.319360 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7ac6c-27d5-4874-96ff-0435318a60a6 None admin] RBAC: Authorizing `identity:get_user(user_id=69c62b93d65347deb4a3134278885674)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:57.320836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7ac6c-27d5-4874-96ff-0435318a60a6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:57.323725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 63/127] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:57 2022] GET /identity/v3/users/69c62b93d65347deb4a3134278885674 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:57.325495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7ac6c-27d5-4874-96ff-0435318a60a6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:57.343763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcf501-799a-40f7-be17-d10a89d47c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:57.344600 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcf501-799a-40f7-be17-d10a89d47c8f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:57.344895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcf501-799a-40f7-be17-d10a89d47c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:57.345181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcf501-799a-40f7-be17-d10a89d47c8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:57.368454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcf501-799a-40f7-be17-d10a89d47c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-67bcf501-799a-40f7-be17-d10a89d47c8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:57.379181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:57.380082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:18:57.380862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:18:57.385208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 65/128] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:57.386096 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcf501-799a-40f7-be17-d10a89d47c8f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:57.403984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:57.484697 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7ac6c-27d5-4874-96ff-0435318a60a6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:57.515235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcf501-799a-40f7-be17-d10a89d47c8f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:57.543374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d06d8c-81fd-491c-952d-869a8ef62e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:57.544488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d06d8c-81fd-491c-952d-869a8ef62e40 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:57.545018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d06d8c-81fd-491c-952d-869a8ef62e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:57.545456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d06d8c-81fd-491c-952d-869a8ef62e40 None admin] PATH_INFO: `/v3/projects/48ae805724e640728c652e5cc574c836` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:57.547488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d06d8c-81fd-491c-952d-869a8ef62e40 None admin] RBAC: Authorizing `identity:get_project(project_id=48ae805724e640728c652e5cc574c836)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:57.548967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d06d8c-81fd-491c-952d-869a8ef62e40 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:57.550943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 64/129] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:18:57 2022] GET /identity/v3/projects/48ae805724e640728c652e5cc574c836 => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:57.551770 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d06d8c-81fd-491c-952d-869a8ef62e40 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:57.566573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84676f2f-8128-46d6-8e5b-e9fb34483669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:57.567798 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84676f2f-8128-46d6-8e5b-e9fb34483669 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:57.572946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84676f2f-8128-46d6-8e5b-e9fb34483669 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:57.573450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84676f2f-8128-46d6-8e5b-e9fb34483669 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:57.575390 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84676f2f-8128-46d6-8e5b-e9fb34483669 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:57.582376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84676f2f-8128-46d6-8e5b-e9fb34483669 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:57.582376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 66/130] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:18:57 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:57.583315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84676f2f-8128-46d6-8e5b-e9fb34483669 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:57.676744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:57.695289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:57.718757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84676f2f-8128-46d6-8e5b-e9fb34483669 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:57.757194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bc176-72a8-4737-88ba-ecffd460248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:57.758191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bc176-72a8-4737-88ba-ecffd460248c None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:57.758511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bc176-72a8-4737-88ba-ecffd460248c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:57.758800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bc176-72a8-4737-88ba-ecffd460248c None admin] PATH_INFO: `/v3/projects/48ae805724e640728c652e5cc574c836/users/69c62b93d65347deb4a3134278885674/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:57.760777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bc176-72a8-4737-88ba-ecffd460248c None admin] RBAC: Authorizing `identity:create_grant(project_id=48ae805724e640728c652e5cc574c836, user_id=69c62b93d65347deb4a3134278885674, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:57.762249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bc176-72a8-4737-88ba-ecffd460248c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:57.784915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 67/131] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:18:57 2022] PUT /identity/v3/projects/48ae805724e640728c652e5cc574c836/users/69c62b93d65347deb4a3134278885674/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:18:57.787369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bc176-72a8-4737-88ba-ecffd460248c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:57.790317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d06d8c-81fd-491c-952d-869a8ef62e40 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:57.885691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f59c6-c4b6-4daa-b134-8422dbd9a57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:57.886812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f59c6-c4b6-4daa-b134-8422dbd9a57b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:57.887320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f59c6-c4b6-4daa-b134-8422dbd9a57b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:57.887815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f59c6-c4b6-4daa-b134-8422dbd9a57b None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:57.888876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f59c6-c4b6-4daa-b134-8422dbd9a57b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:57.889458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f59c6-c4b6-4daa-b134-8422dbd9a57b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:57.891194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f59c6-c4b6-4daa-b134-8422dbd9a57b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:57.921067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 65/132] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:18:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:57.933040 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f59c6-c4b6-4daa-b134-8422dbd9a57b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:57.976430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bc176-72a8-4737-88ba-ecffd460248c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:58.046606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd24d8-82f1-4f33-823f-86c953627b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:58.047531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd24d8-82f1-4f33-823f-86c953627b38 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:58.047820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd24d8-82f1-4f33-823f-86c953627b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:58.048100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd24d8-82f1-4f33-823f-86c953627b38 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e/users/69c62b93d65347deb4a3134278885674/roles/d3f29bc0265f45979298aa97cf42ee59` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:58.053661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd24d8-82f1-4f33-823f-86c953627b38 None admin] RBAC: Authorizing `identity:create_grant(project_id=0de6538741964c2b8766be7436e4800e, user_id=69c62b93d65347deb4a3134278885674, role_id=d3f29bc0265f45979298aa97cf42ee59)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:58.055163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd24d8-82f1-4f33-823f-86c953627b38 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:58.086036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 68/133] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:18:57 2022] PUT /identity/v3/projects/0de6538741964c2b8766be7436e4800e/users/69c62b93d65347deb4a3134278885674/roles/d3f29bc0265f45979298aa97cf42ee59 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:18:58.086212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:58.112651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f59c6-c4b6-4daa-b134-8422dbd9a57b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:58.148325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:58.160721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff762e-f0c7-4328-8640-18852b1e9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:58.161635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff762e-f0c7-4328-8640-18852b1e9db2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:58.161926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff762e-f0c7-4328-8640-18852b1e9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:58.162206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff762e-f0c7-4328-8640-18852b1e9db2 None admin] PATH_INFO: `/v3/users/dcce859b2c03445985c3a29b4b31405a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:58.187679 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff762e-f0c7-4328-8640-18852b1e9db2 None admin] RBAC: Authorizing `identity:get_user(user_id=dcce859b2c03445985c3a29b4b31405a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:58.189164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff762e-f0c7-4328-8640-18852b1e9db2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:58.191348 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 66/134] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:57 2022] GET /identity/v3/users/dcce859b2c03445985c3a29b4b31405a => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:58.197481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd24d8-82f1-4f33-823f-86c953627b38 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:58.214803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392e892-2acf-4727-9797-9fee12ccda2e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:58.215448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392e892-2acf-4727-9797-9fee12ccda2e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:58.215937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392e892-2acf-4727-9797-9fee12ccda2e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:58.218116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 67/135] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:58.226117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b7827-f939-4d94-b6a9-05c249a4afa2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:58.228113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b7827-f939-4d94-b6a9-05c249a4afa2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:58.229337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b7827-f939-4d94-b6a9-05c249a4afa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:58.283474 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dc6b7827-f939-4d94-b6a9-05c249a4afa2 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:58.285030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dc6b7827-f939-4d94-b6a9-05c249a4afa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:58.346347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd24d8-82f1-4f33-823f-86c953627b38 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:58.402473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832a29a-5ba7-4585-bf27-f867645c94ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:58.403062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832a29a-5ba7-4585-bf27-f867645c94ad None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:58.404172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832a29a-5ba7-4585-bf27-f867645c94ad None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:58.404469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832a29a-5ba7-4585-bf27-f867645c94ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:58.453374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 68/136] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:58.483705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b7827-f939-4d94-b6a9-05c249a4afa2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:58.565369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:58.569242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832a29a-5ba7-4585-bf27-f867645c94ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:58.569356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832a29a-5ba7-4585-bf27-f867645c94ad None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:58.709737 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b7827-f939-4d94-b6a9-05c249a4afa2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:58.732518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:58.757715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6d15c-0bcb-4644-a0da-5253737ff137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:58.758546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d15c-0bcb-4644-a0da-5253737ff137 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:58.758836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d15c-0bcb-4644-a0da-5253737ff137 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:58.762375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d15c-0bcb-4644-a0da-5253737ff137 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:58.769838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6d15c-0bcb-4644-a0da-5253737ff137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-83e6d15c-0bcb-4644-a0da-5253737ff137 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:58.777542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:58.778418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:18:58.779204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 69/137] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:18:58.784417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6d15c-0bcb-4644-a0da-5253737ff137 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:58.787180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 69/138] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:58.793007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832a29a-5ba7-4585-bf27-f867645c94ad None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:58.896076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6d15c-0bcb-4644-a0da-5253737ff137 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:58.934132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ee325-fb89-48d2-abcd-51560bccfa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:58.934994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ee325-fb89-48d2-abcd-51560bccfa8a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:58.935289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ee325-fb89-48d2-abcd-51560bccfa8a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:58.935572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ee325-fb89-48d2-abcd-51560bccfa8a None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:58.936381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ee325-fb89-48d2-abcd-51560bccfa8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:58.936696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ee325-fb89-48d2-abcd-51560bccfa8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:58.938379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ee325-fb89-48d2-abcd-51560bccfa8a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:58.949110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 70/139] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:18:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:58.955145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ee325-fb89-48d2-abcd-51560bccfa8a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:59.012677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:59.075408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:59.078472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ee325-fb89-48d2-abcd-51560bccfa8a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:59.084249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832a29a-5ba7-4585-bf27-f867645c94ad None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:59.116625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f292a4a-1cd5-4cf4-b83f-32a0cd1c4b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:59.117509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f292a4a-1cd5-4cf4-b83f-32a0cd1c4b5b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:59.117797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f292a4a-1cd5-4cf4-b83f-32a0cd1c4b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:59.118077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f292a4a-1cd5-4cf4-b83f-32a0cd1c4b5b None admin] PATH_INFO: `/v3/users/69c62b93d65347deb4a3134278885674` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:59.119603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f292a4a-1cd5-4cf4-b83f-32a0cd1c4b5b None admin] RBAC: Authorizing `identity:get_user(user_id=69c62b93d65347deb4a3134278885674)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:59.121239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f292a4a-1cd5-4cf4-b83f-32a0cd1c4b5b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:59.123558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 71/140] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:18:58 2022] GET /identity/v3/users/69c62b93d65347deb4a3134278885674 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:59.129534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f292a4a-1cd5-4cf4-b83f-32a0cd1c4b5b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:59.152609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099de4f0-7118-461b-a2cf-27ebff7f9daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:59.153796 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099de4f0-7118-461b-a2cf-27ebff7f9daf None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:59.154286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099de4f0-7118-461b-a2cf-27ebff7f9daf None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:59.155429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099de4f0-7118-461b-a2cf-27ebff7f9daf None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:59.163238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099de4f0-7118-461b-a2cf-27ebff7f9daf None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:59.165145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099de4f0-7118-461b-a2cf-27ebff7f9daf None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:59.167131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 70/141] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:18:58 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:59.173498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099de4f0-7118-461b-a2cf-27ebff7f9daf None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:59.243229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f292a4a-1cd5-4cf4-b83f-32a0cd1c4b5b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:59.244796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:59.284009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d3a01-05e3-4d1f-847a-97bc93232c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:59.284678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d3a01-05e3-4d1f-847a-97bc93232c42 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:59.285038 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d3a01-05e3-4d1f-847a-97bc93232c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:59.285331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d3a01-05e3-4d1f-847a-97bc93232c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:59.375320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099de4f0-7118-461b-a2cf-27ebff7f9daf None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:59.378116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d3a01-05e3-4d1f-847a-97bc93232c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:59.381188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d3a01-05e3-4d1f-847a-97bc93232c42 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:59.429759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd8378-6d5f-4f3e-8bcf-3f3fd5ca4792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:59.431579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd8378-6d5f-4f3e-8bcf-3f3fd5ca4792 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:59.433226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd8378-6d5f-4f3e-8bcf-3f3fd5ca4792 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:59.433937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd8378-6d5f-4f3e-8bcf-3f3fd5ca4792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:59.435929 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd8378-6d5f-4f3e-8bcf-3f3fd5ca4792 None admin] RBAC: Adding query filter params (role.id=1cfde5f2028c4ee8aa20c8665a6078e3, scope.project.id=0de6538741964c2b8766be7436e4800e, user.id=dcce859b2c03445985c3a29b4b31405a) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:18:59.437330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd8378-6d5f-4f3e-8bcf-3f3fd5ca4792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:59.440517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd8378-6d5f-4f3e-8bcf-3f3fd5ca4792 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:59.457246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 71/142] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:18:59 2022] GET /identity/v3/role_assignments?user.id=dcce859b2c03445985c3a29b4b31405a&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=1cfde5f2028c4ee8aa20c8665a6078e3 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:18:59.458931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa9fda-a575-433e-b1f0-91e8a04f6418 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:59.459424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa9fda-a575-433e-b1f0-91e8a04f6418 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:59.459901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa9fda-a575-433e-b1f0-91e8a04f6418 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:59.461451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 72/143] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:18:59.467103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa479d-c3ae-4e6f-957c-d2e34491f654 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:59.468247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa479d-c3ae-4e6f-957c-d2e34491f654 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:59.468727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa479d-c3ae-4e6f-957c-d2e34491f654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:59.508754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3baa479d-c3ae-4e6f-957c-d2e34491f654 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:18:59.510895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3baa479d-c3ae-4e6f-957c-d2e34491f654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:18:59.575453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:59.612910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 72/144] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:18:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:59.632234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d3a01-05e3-4d1f-847a-97bc93232c42 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:59.634749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:59.646396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 73/145] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:59.684677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa479d-c3ae-4e6f-957c-d2e34491f654 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:59.771503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d3a01-05e3-4d1f-847a-97bc93232c42 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:59.827384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa479d-c3ae-4e6f-957c-d2e34491f654 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:18:59.836690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789acd1-4d10-42a7-b709-4d1415b194f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:59.837583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789acd1-4d10-42a7-b709-4d1415b194f9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:59.837881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789acd1-4d10-42a7-b709-4d1415b194f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:59.838179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789acd1-4d10-42a7-b709-4d1415b194f9 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:59.843309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789acd1-4d10-42a7-b709-4d1415b194f9 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:18:59.844797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789acd1-4d10-42a7-b709-4d1415b194f9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:18:59.846658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 73/146] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:18:59 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:18:59.852771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789acd1-4d10-42a7-b709-4d1415b194f9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:59.867686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9551ac-e1f8-459d-a675-db0e0c93b8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:18:59.868717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9551ac-e1f8-459d-a675-db0e0c93b8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:18:59.869142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9551ac-e1f8-459d-a675-db0e0c93b8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:18:59.869580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9551ac-e1f8-459d-a675-db0e0c93b8d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:18:59.882859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9551ac-e1f8-459d-a675-db0e0c93b8d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ee9551ac-e1f8-459d-a675-db0e0c93b8d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:18:59.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:18:59.891889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:18:59.892687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:18:59.895457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 74/147] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:18:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:18:59.904471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9551ac-e1f8-459d-a675-db0e0c93b8d1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:18:59.941103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:59.990377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:00.033188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789acd1-4d10-42a7-b709-4d1415b194f9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:00.064147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9551ac-e1f8-459d-a675-db0e0c93b8d1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:00.111172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1711a-9a2c-4ad3-a15a-94bf769ccb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:00.111753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1711a-9a2c-4ad3-a15a-94bf769ccb71 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:00.112045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1711a-9a2c-4ad3-a15a-94bf769ccb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:00.112330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1711a-9a2c-4ad3-a15a-94bf769ccb71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:00.113180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1711a-9a2c-4ad3-a15a-94bf769ccb71 None admin] RBAC: Adding query filter params (role.id=6c516ab551054fc8bd24c92c7d9173ba, scope.project.id=0de6538741964c2b8766be7436e4800e, user.id=69c62b93d65347deb4a3134278885674) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:00.113501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1711a-9a2c-4ad3-a15a-94bf769ccb71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:00.118373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1711a-9a2c-4ad3-a15a-94bf769ccb71 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:00.121289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 74/148] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:18:59 2022] GET /identity/v3/role_assignments?user.id=69c62b93d65347deb4a3134278885674&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:00.123005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6a74-8677-4374-8532-5315c7343190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:00.123942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6a74-8677-4374-8532-5315c7343190 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:00.124440 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6a74-8677-4374-8532-5315c7343190 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:00.124926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6a74-8677-4374-8532-5315c7343190 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:00.125959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e6a74-8677-4374-8532-5315c7343190 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:00.126578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e6a74-8677-4374-8532-5315c7343190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:00.128281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e6a74-8677-4374-8532-5315c7343190 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:00.138199 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 75/149] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:18:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:00.147838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1711a-9a2c-4ad3-a15a-94bf769ccb71 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:00.311966 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1711a-9a2c-4ad3-a15a-94bf769ccb71 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:00.371717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c599e-993e-4e4e-a94a-3418491a70d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:00.372547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c599e-993e-4e4e-a94a-3418491a70d0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:00.372837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c599e-993e-4e4e-a94a-3418491a70d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:00.373117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c599e-993e-4e4e-a94a-3418491a70d0 None admin] PATH_INFO: `/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:00.374979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c599e-993e-4e4e-a94a-3418491a70d0 None admin] RBAC: Authorizing `identity:get_user(user_id=7e9b1eea1bc44e2ab2c9802f041f72c3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:00.376454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c599e-993e-4e4e-a94a-3418491a70d0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:00.378487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 75/150] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:00 2022] GET /identity/v3/users/7e9b1eea1bc44e2ab2c9802f041f72c3 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:00.383709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6a74-8677-4374-8532-5315c7343190 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:00.384087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695cf2-991c-41b5-ad6c-556e0aac6f77 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:00.384389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695cf2-991c-41b5-ad6c-556e0aac6f77 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:00.384677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695cf2-991c-41b5-ad6c-556e0aac6f77 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:00.386153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 76/151] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:00.392071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59486ae-fa1c-4b7f-9230-3691dab5c18a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:00.392367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59486ae-fa1c-4b7f-9230-3691dab5c18a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:00.392648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59486ae-fa1c-4b7f-9230-3691dab5c18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:00.397813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:00.411958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c59486ae-fa1c-4b7f-9230-3691dab5c18a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:00.413168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c59486ae-fa1c-4b7f-9230-3691dab5c18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:00.544790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 77/152] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:00.563280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:00.591318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6a74-8677-4374-8532-5315c7343190 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:00.638987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e53f3a-f14f-4361-93aa-0ab3486e4953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:00.639770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53f3a-f14f-4361-93aa-0ab3486e4953 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:00.640059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53f3a-f14f-4361-93aa-0ab3486e4953 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:00.640338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53f3a-f14f-4361-93aa-0ab3486e4953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:00.649162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59486ae-fa1c-4b7f-9230-3691dab5c18a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:00.725579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e53f3a-f14f-4361-93aa-0ab3486e4953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:00.731522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e53f3a-f14f-4361-93aa-0ab3486e4953 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:00.791307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59486ae-fa1c-4b7f-9230-3691dab5c18a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:00.824532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:00.847653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574534b-0ff3-45e9-bb43-e458b1823518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:00.848488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574534b-0ff3-45e9-bb43-e458b1823518 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:00.848759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574534b-0ff3-45e9-bb43-e458b1823518 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:00.849092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574534b-0ff3-45e9-bb43-e458b1823518 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:00.854699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:00.858379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574534b-0ff3-45e9-bb43-e458b1823518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:00.858379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574534b-0ff3-45e9-bb43-e458b1823518 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:00.858674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 78/153] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:00.864072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574534b-0ff3-45e9-bb43-e458b1823518 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:00.877033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 76/154] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:00.880285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85a28e-8cfc-4449-b232-00309b6304a4 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:00.880810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85a28e-8cfc-4449-b232-00309b6304a4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:00.881297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85a28e-8cfc-4449-b232-00309b6304a4 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:00.883065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 77/155] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:19:00.883984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85a28e-8cfc-4449-b232-00309b6304a4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:00.986533 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574534b-0ff3-45e9-bb43-e458b1823518 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:01.022556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52523932-ec59-4571-a318-8a1a59c29e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:01.023234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52523932-ec59-4571-a318-8a1a59c29e9a None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.023521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52523932-ec59-4571-a318-8a1a59c29e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.023806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52523932-ec59-4571-a318-8a1a59c29e9a None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.024546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52523932-ec59-4571-a318-8a1a59c29e9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:01.025224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85a28e-8cfc-4449-b232-00309b6304a4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:01.025998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52523932-ec59-4571-a318-8a1a59c29e9a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:01.066901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 79/156] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:19:00 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:19:01.068414 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06667e-edf2-4ddb-b6af-c30cf3e00696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:01.068690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f88c4-e2f4-48d3-82a8-1d8db016f3b6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.068995 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f88c4-e2f4-48d3-82a8-1d8db016f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.069327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f88c4-e2f4-48d3-82a8-1d8db016f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.069513 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06667e-edf2-4ddb-b6af-c30cf3e00696 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.069862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06667e-edf2-4ddb-b6af-c30cf3e00696 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.070203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06667e-edf2-4ddb-b6af-c30cf3e00696 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.071505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06667e-edf2-4ddb-b6af-c30cf3e00696 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:01.073043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06667e-edf2-4ddb-b6af-c30cf3e00696 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:01.075078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 78/157] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:00 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:01.081292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06667e-edf2-4ddb-b6af-c30cf3e00696 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:01.099710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-cf7f88c4-e2f4-48d3-82a8-1d8db016f3b6 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:01.101126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cf7f88c4-e2f4-48d3-82a8-1d8db016f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:01.148779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:01.179862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:01.202214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 80/158] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:01.203708 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d97de-a8b8-48ed-bcf7-c1d7a62614a5 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.204104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d97de-a8b8-48ed-bcf7-c1d7a62614a5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.204489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d97de-a8b8-48ed-bcf7-c1d7a62614a5 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.206267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 81/159] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:01.211442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a8afe-51c4-4332-b8b5-f46aad37e818 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.211859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a8afe-51c4-4332-b8b5-f46aad37e818 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.212241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a8afe-51c4-4332-b8b5-f46aad37e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.225191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06667e-edf2-4ddb-b6af-c30cf3e00696 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:01.246957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d60a8afe-51c4-4332-b8b5-f46aad37e818 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:01.248243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d60a8afe-51c4-4332-b8b5-f46aad37e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:01.278486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b944d-621b-4b4f-b679-c29024ddb15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:01.279161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b944d-621b-4b4f-b679-c29024ddb15a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.279456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b944d-621b-4b4f-b679-c29024ddb15a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.280250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b944d-621b-4b4f-b679-c29024ddb15a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.281101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b944d-621b-4b4f-b679-c29024ddb15a None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=0de6538741964c2b8766be7436e4800e, user.id=7e9b1eea1bc44e2ab2c9802f041f72c3) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:01.281416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b944d-621b-4b4f-b679-c29024ddb15a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:01.283068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b944d-621b-4b4f-b679-c29024ddb15a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:01.294380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 79/160] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:01 2022] GET /identity/v3/role_assignments?user.id=7e9b1eea1bc44e2ab2c9802f041f72c3&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:01.294380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b944d-621b-4b4f-b679-c29024ddb15a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:01.337354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 82/161] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:01.364288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a8afe-51c4-4332-b8b5-f46aad37e818 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:01.414296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b944d-621b-4b4f-b679-c29024ddb15a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:01.436575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:01.457571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d70e-ffcc-4a0e-8ef5-1092cd993dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:01.458529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d70e-ffcc-4a0e-8ef5-1092cd993dfe None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.458823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d70e-ffcc-4a0e-8ef5-1092cd993dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.459106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52d70e-ffcc-4a0e-8ef5-1092cd993dfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.472301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52d70e-ffcc-4a0e-8ef5-1092cd993dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:01.479438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a8afe-51c4-4332-b8b5-f46aad37e818 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ed52d70e-ffcc-4a0e-8ef5-1092cd993dfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:01.480787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:01.481630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:01.482547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 80/162] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:01.489839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d70e-ffcc-4a0e-8ef5-1092cd993dfe None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:01.497743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:01.517718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec5e41-cd0f-4948-9b4f-1b7e9bcbbe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:01.518557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5e41-cd0f-4948-9b4f-1b7e9bcbbe86 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.518849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5e41-cd0f-4948-9b4f-1b7e9bcbbe86 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.519124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5e41-cd0f-4948-9b4f-1b7e9bcbbe86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.532441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec5e41-cd0f-4948-9b4f-1b7e9bcbbe86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-e2ec5e41-cd0f-4948-9b4f-1b7e9bcbbe86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:01.541259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:01.543323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:01.545175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 83/163] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:01.548865 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec5e41-cd0f-4948-9b4f-1b7e9bcbbe86 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:01.615955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52d70e-ffcc-4a0e-8ef5-1092cd993dfe None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:01.662102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac2b8c-5526-4b14-a5ba-67e27d0e4e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:01.663400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac2b8c-5526-4b14-a5ba-67e27d0e4e1f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.663696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac2b8c-5526-4b14-a5ba-67e27d0e4e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.663983 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac2b8c-5526-4b14-a5ba-67e27d0e4e1f None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.665050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac2b8c-5526-4b14-a5ba-67e27d0e4e1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:01.665366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac2b8c-5526-4b14-a5ba-67e27d0e4e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:01.667977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac2b8c-5526-4b14-a5ba-67e27d0e4e1f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:01.680625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 81/164] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:01.686423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac2b8c-5526-4b14-a5ba-67e27d0e4e1f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:01.710427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec5e41-cd0f-4948-9b4f-1b7e9bcbbe86 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:01.739076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:01.747076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952682d-7159-436c-b06b-a200d27f5b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:01.747810 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952682d-7159-436c-b06b-a200d27f5b1e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.748041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952682d-7159-436c-b06b-a200d27f5b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.748322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952682d-7159-436c-b06b-a200d27f5b1e None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.749109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952682d-7159-436c-b06b-a200d27f5b1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:01.749421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952682d-7159-436c-b06b-a200d27f5b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:01.750864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952682d-7159-436c-b06b-a200d27f5b1e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:01.763295 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 84/165] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:01.769271 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952682d-7159-436c-b06b-a200d27f5b1e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:01.804029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac2b8c-5526-4b14-a5ba-67e27d0e4e1f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:01.815486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:01.845717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900558f-41ef-42ca-b34d-08c9b30b0786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:01.847033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900558f-41ef-42ca-b34d-08c9b30b0786 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.847630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900558f-41ef-42ca-b34d-08c9b30b0786 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.848103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900558f-41ef-42ca-b34d-08c9b30b0786 None admin] PATH_INFO: `/v3/users/69c62b93d65347deb4a3134278885674` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.849553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900558f-41ef-42ca-b34d-08c9b30b0786 None admin] RBAC: Authorizing `identity:get_user(user_id=69c62b93d65347deb4a3134278885674)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:01.851235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900558f-41ef-42ca-b34d-08c9b30b0786 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:01.853174 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 82/166] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:01 2022] GET /identity/v3/users/69c62b93d65347deb4a3134278885674 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:01.861641 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900558f-41ef-42ca-b34d-08c9b30b0786 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:01.895032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952682d-7159-436c-b06b-a200d27f5b1e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:01.931337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e880d-98da-4d07-b0e7-94fbc22bcc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:01.931956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e880d-98da-4d07-b0e7-94fbc22bcc4b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:01.932242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e880d-98da-4d07-b0e7-94fbc22bcc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:01.932521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e880d-98da-4d07-b0e7-94fbc22bcc4b None admin] PATH_INFO: `/v3/users/69c62b93d65347deb4a3134278885674` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:01.934754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e880d-98da-4d07-b0e7-94fbc22bcc4b None admin] RBAC: Authorizing `identity:get_user(user_id=69c62b93d65347deb4a3134278885674)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:01.936771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e880d-98da-4d07-b0e7-94fbc22bcc4b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:01.938901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 85/167] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:01 2022] GET /identity/v3/users/69c62b93d65347deb4a3134278885674 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:01.945304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e880d-98da-4d07-b0e7-94fbc22bcc4b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:01.989942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900558f-41ef-42ca-b34d-08c9b30b0786 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:01.998863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:02.031511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1ce6c-0bc1-442b-990d-926eedd4b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:02.032584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1ce6c-0bc1-442b-990d-926eedd4b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:02.033062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1ce6c-0bc1-442b-990d-926eedd4b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:02.033647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1ce6c-0bc1-442b-990d-926eedd4b2d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:02.056249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e880d-98da-4d07-b0e7-94fbc22bcc4b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:02.064238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:02.094636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce62dfc-61da-4622-aee6-766bf7277eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:02.095297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce62dfc-61da-4622-aee6-766bf7277eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:02.095649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce62dfc-61da-4622-aee6-766bf7277eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:02.095933 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce62dfc-61da-4622-aee6-766bf7277eb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:02.114236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1ce6c-0bc1-442b-990d-926eedd4b2d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:02.116263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1ce6c-0bc1-442b-990d-926eedd4b2d8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:02.168096 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce62dfc-61da-4622-aee6-766bf7277eb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:02.169581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce62dfc-61da-4622-aee6-766bf7277eb2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:02.255189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 83/168] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:02.257852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e437b66-5f82-42be-b12c-5b43994b5f32 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:02.258493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e437b66-5f82-42be-b12c-5b43994b5f32 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:02.258968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e437b66-5f82-42be-b12c-5b43994b5f32 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:02.260519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 84/169] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:02.265424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e437b66-5f82-42be-b12c-5b43994b5f32 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:02.280057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 86/170] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:02.281373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68720c4-f827-4507-9e66-ecf3999bb4c4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:02.281667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68720c4-f827-4507-9e66-ecf3999bb4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:02.281947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68720c4-f827-4507-9e66-ecf3999bb4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:02.288663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:02.303324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:02.314417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c68720c4-f827-4507-9e66-ecf3999bb4c4 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:02.316530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c68720c4-f827-4507-9e66-ecf3999bb4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:02.410955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 87/171] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:02.412175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68720c4-f827-4507-9e66-ecf3999bb4c4 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:02.540673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68720c4-f827-4507-9e66-ecf3999bb4c4 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:02.563050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e437b66-5f82-42be-b12c-5b43994b5f32 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:02.581990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b85707-4451-4f1d-8c8d-f0cddd1c8da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:02.582990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85707-4451-4f1d-8c8d-f0cddd1c8da8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:02.583375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85707-4451-4f1d-8c8d-f0cddd1c8da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:02.583750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85707-4451-4f1d-8c8d-f0cddd1c8da8 None admin] PATH_INFO: `/v3/projects/48ae805724e640728c652e5cc574c836` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:02.585018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b85707-4451-4f1d-8c8d-f0cddd1c8da8 None admin] RBAC: Authorizing `identity:get_project(project_id=48ae805724e640728c652e5cc574c836)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:02.586598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b85707-4451-4f1d-8c8d-f0cddd1c8da8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:02.589357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 88/172] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:02 2022] GET /identity/v3/projects/48ae805724e640728c652e5cc574c836 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:02.590276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b85707-4451-4f1d-8c8d-f0cddd1c8da8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:02.594522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:02.640007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8d21-bc26-4fb1-b8b6-2acf8beda826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:02.641557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8d21-bc26-4fb1-b8b6-2acf8beda826 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:02.642060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8d21-bc26-4fb1-b8b6-2acf8beda826 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:02.642645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8d21-bc26-4fb1-b8b6-2acf8beda826 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:02.644044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb8d21-bc26-4fb1-b8b6-2acf8beda826 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:02.645708 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb8d21-bc26-4fb1-b8b6-2acf8beda826 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:02.647657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 85/173] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:02 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:02.648631 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8d21-bc26-4fb1-b8b6-2acf8beda826 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:02.699915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b85707-4451-4f1d-8c8d-f0cddd1c8da8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:02.737197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe4d98-11af-48e6-9b38-b5d0d2b94322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:02.738170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe4d98-11af-48e6-9b38-b5d0d2b94322 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:02.738483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe4d98-11af-48e6-9b38-b5d0d2b94322 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:02.738759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe4d98-11af-48e6-9b38-b5d0d2b94322 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:02.750074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe4d98-11af-48e6-9b38-b5d0d2b94322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-25fe4d98-11af-48e6-9b38-b5d0d2b94322 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:02.758185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:02.759196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:02.759994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 89/174] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:02.760659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe4d98-11af-48e6-9b38-b5d0d2b94322 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:02.768373 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:02.814175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8d21-bc26-4fb1-b8b6-2acf8beda826 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:02.831421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:02.869743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d13ae-2f0c-4e5c-8ce7-a94ffb2597f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:02.870444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d13ae-2f0c-4e5c-8ce7-a94ffb2597f2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:02.870732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d13ae-2f0c-4e5c-8ce7-a94ffb2597f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:02.871010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d13ae-2f0c-4e5c-8ce7-a94ffb2597f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:02.871851 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d13ae-2f0c-4e5c-8ce7-a94ffb2597f2 None admin] RBAC: Adding query filter params (role.id=6c516ab551054fc8bd24c92c7d9173ba, scope.project.id=48ae805724e640728c652e5cc574c836, user.id=69c62b93d65347deb4a3134278885674) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:02.872169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d13ae-2f0c-4e5c-8ce7-a94ffb2597f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:02.873663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d13ae-2f0c-4e5c-8ce7-a94ffb2597f2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:02.883237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe4d98-11af-48e6-9b38-b5d0d2b94322 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:02.886008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 86/175] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:02 2022] GET /identity/v3/role_assignments?user.id=69c62b93d65347deb4a3134278885674&scope.project.id=48ae805724e640728c652e5cc574c836&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:02.886779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d13ae-2f0c-4e5c-8ce7-a94ffb2597f2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:02.921738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942ee4-fe0f-4879-81c1-70002110eba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:02.922812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942ee4-fe0f-4879-81c1-70002110eba8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:02.923331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942ee4-fe0f-4879-81c1-70002110eba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:02.923794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91942ee4-fe0f-4879-81c1-70002110eba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:02.924820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91942ee4-fe0f-4879-81c1-70002110eba8 None admin] RBAC: Adding query filter params (role.id=d3f29bc0265f45979298aa97cf42ee59, scope.project.id=0de6538741964c2b8766be7436e4800e, user.id=69c62b93d65347deb4a3134278885674) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:02.925325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91942ee4-fe0f-4879-81c1-70002110eba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:02.927238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91942ee4-fe0f-4879-81c1-70002110eba8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:02.934771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 90/176] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:02 2022] GET /identity/v3/role_assignments?user.id=69c62b93d65347deb4a3134278885674&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=d3f29bc0265f45979298aa97cf42ee59 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:03.012225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d13ae-2f0c-4e5c-8ce7-a94ffb2597f2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:03.050168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093efd51-dafd-40cd-b503-bd8ab706ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:03.051499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093efd51-dafd-40cd-b503-bd8ab706ec23 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:03.051975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093efd51-dafd-40cd-b503-bd8ab706ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:03.052456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093efd51-dafd-40cd-b503-bd8ab706ec23 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:03.053400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093efd51-dafd-40cd-b503-bd8ab706ec23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:03.053894 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093efd51-dafd-40cd-b503-bd8ab706ec23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:03.055608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093efd51-dafd-40cd-b503-bd8ab706ec23 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:03.061691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:03.065527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 87/177] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:03.071134 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942ee4-fe0f-4879-81c1-70002110eba8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:03.197518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91942ee4-fe0f-4879-81c1-70002110eba8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:03.229531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:03.239404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c108d-8240-4fc0-b2bf-3e7337442a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:03.240304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c108d-8240-4fc0-b2bf-3e7337442a72 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:03.240586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c108d-8240-4fc0-b2bf-3e7337442a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:03.240857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c108d-8240-4fc0-b2bf-3e7337442a72 None admin] PATH_INFO: `/v3/users/dcce859b2c03445985c3a29b4b31405a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:03.242117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c108d-8240-4fc0-b2bf-3e7337442a72 None admin] RBAC: Authorizing `identity:get_user(user_id=dcce859b2c03445985c3a29b4b31405a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:03.243592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c108d-8240-4fc0-b2bf-3e7337442a72 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:03.245458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 91/178] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:03 2022] GET /identity/v3/users/dcce859b2c03445985c3a29b4b31405a => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:03.251125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093efd51-dafd-40cd-b503-bd8ab706ec23 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:03.357513 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093efd51-dafd-40cd-b503-bd8ab706ec23 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:03.395996 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5a70-ef6a-4e49-b4e2-1daf6f0ea882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:03.397228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5a70-ef6a-4e49-b4e2-1daf6f0ea882 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:03.397711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5a70-ef6a-4e49-b4e2-1daf6f0ea882 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:03.398207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5a70-ef6a-4e49-b4e2-1daf6f0ea882 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:03.399875 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef5a70-ef6a-4e49-b4e2-1daf6f0ea882 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:03.401554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef5a70-ef6a-4e49-b4e2-1daf6f0ea882 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:03.403511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 88/179] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:03 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:03.409396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c108d-8240-4fc0-b2bf-3e7337442a72 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:03.542320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c108d-8240-4fc0-b2bf-3e7337442a72 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:03.585209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd06ae-77f2-477f-887c-8fd4a97ca4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:03.586108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd06ae-77f2-477f-887c-8fd4a97ca4f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:03.586417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd06ae-77f2-477f-887c-8fd4a97ca4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:03.586693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd06ae-77f2-477f-887c-8fd4a97ca4f6 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e/users/dcce859b2c03445985c3a29b4b31405a/roles/1cfde5f2028c4ee8aa20c8665a6078e3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:03.588662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd06ae-77f2-477f-887c-8fd4a97ca4f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0de6538741964c2b8766be7436e4800e, user_id=dcce859b2c03445985c3a29b4b31405a, role_id=1cfde5f2028c4ee8aa20c8665a6078e3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:03.590098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd06ae-77f2-477f-887c-8fd4a97ca4f6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:03.610685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 92/180] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:19:03 2022] PUT /identity/v3/projects/0de6538741964c2b8766be7436e4800e/users/dcce859b2c03445985c3a29b4b31405a/roles/1cfde5f2028c4ee8aa20c8665a6078e3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:04.142689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638318a-8190-4a79-906c-30d4e1ec45ad None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.143706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638318a-8190-4a79-906c-30d4e1ec45ad None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.144220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638318a-8190-4a79-906c-30d4e1ec45ad None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.146042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 89/181] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:04.151456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bbec-d764-4313-8b18-dff3cf6ab037 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.152258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bbec-d764-4313-8b18-dff3cf6ab037 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.152752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bbec-d764-4313-8b18-dff3cf6ab037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.171208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-55b1bbec-d764-4313-8b18-dff3cf6ab037 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:04.172734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-55b1bbec-d764-4313-8b18-dff3cf6ab037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:04.228142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:04.246190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 93/182] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:04.262515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f8390-9444-4556-9b0c-692d42916431 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.262792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f8390-9444-4556-9b0c-692d42916431 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.263076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f8390-9444-4556-9b0c-692d42916431 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.264745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 90/183] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:04.271762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e182d-73f4-4a32-8c5e-3259b3cbcbfd None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.272069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e182d-73f4-4a32-8c5e-3259b3cbcbfd None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.272594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e182d-73f4-4a32-8c5e-3259b3cbcbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.274688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bbec-d764-4313-8b18-dff3cf6ab037 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:04.290948 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-815e182d-73f4-4a32-8c5e-3259b3cbcbfd None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:04.292433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-815e182d-73f4-4a32-8c5e-3259b3cbcbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:04.366730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 91/184] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:04.370708 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:04.387277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e182d-73f4-4a32-8c5e-3259b3cbcbfd None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:04.393657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bbec-d764-4313-8b18-dff3cf6ab037 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:04.434016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90829c-1ee8-4b42-bfa4-0f0c93ce94b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:04.434857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90829c-1ee8-4b42-bfa4-0f0c93ce94b6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.435144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90829c-1ee8-4b42-bfa4-0f0c93ce94b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.435422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90829c-1ee8-4b42-bfa4-0f0c93ce94b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.446299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90829c-1ee8-4b42-bfa4-0f0c93ce94b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-dc90829c-1ee8-4b42-bfa4-0f0c93ce94b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:04.454301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:04.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:04.455975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 94/185] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:04.457147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cdfee-1bda-40f7-b364-f31164ae3a9a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.457147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cdfee-1bda-40f7-b364-f31164ae3a9a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.457299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cdfee-1bda-40f7-b364-f31164ae3a9a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.458820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 95/186] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:04.462318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cdfee-1bda-40f7-b364-f31164ae3a9a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:04.510832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e182d-73f4-4a32-8c5e-3259b3cbcbfd None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:04.514848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:04.548677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadb23c-86a7-4228-8573-1df40ff9db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:04.549468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadb23c-86a7-4228-8573-1df40ff9db5b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.549793 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadb23c-86a7-4228-8573-1df40ff9db5b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.550019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadb23c-86a7-4228-8573-1df40ff9db5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.560495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadb23c-86a7-4228-8573-1df40ff9db5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-adadb23c-86a7-4228-8573-1df40ff9db5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:04.569548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:04.575442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 92/187] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:04.576775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea756e-8686-46b1-9721-0f08c1f60956 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.577503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea756e-8686-46b1-9721-0f08c1f60956 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.577503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea756e-8686-46b1-9721-0f08c1f60956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.582808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cdfee-1bda-40f7-b364-f31164ae3a9a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:04.592959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-feea756e-8686-46b1-9721-0f08c1f60956 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:04.594199 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-feea756e-8686-46b1-9721-0f08c1f60956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:04.618686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168e03-a649-4630-a6f3-0c931e4bbe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:04.619408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168e03-a649-4630-a6f3-0c931e4bbe14 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.619693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168e03-a649-4630-a6f3-0c931e4bbe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.619975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168e03-a649-4630-a6f3-0c931e4bbe14 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.620783 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29168e03-a649-4630-a6f3-0c931e4bbe14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:04.621088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29168e03-a649-4630-a6f3-0c931e4bbe14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:04.622528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29168e03-a649-4630-a6f3-0c931e4bbe14 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:04.634394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 96/188] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:04.634394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168e03-a649-4630-a6f3-0c931e4bbe14 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:04.657229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:04.671760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 93/189] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:04.672889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea756e-8686-46b1-9721-0f08c1f60956 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:04.760514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168e03-a649-4630-a6f3-0c931e4bbe14 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:04.770293 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:04.779599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea756e-8686-46b1-9721-0f08c1f60956 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:04.798039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffdefe-0621-48c1-9b73-5e85554cecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:04.798748 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffdefe-0621-48c1-9b73-5e85554cecb1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.799034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffdefe-0621-48c1-9b73-5e85554cecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.799313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffdefe-0621-48c1-9b73-5e85554cecb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.800059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffdefe-0621-48c1-9b73-5e85554cecb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:04.800371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffdefe-0621-48c1-9b73-5e85554cecb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:04.801996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffdefe-0621-48c1-9b73-5e85554cecb1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:04.810134 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 97/190] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:04.815887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffdefe-0621-48c1-9b73-5e85554cecb1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:04.817271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b118a-73eb-41c8-8ec8-f24f6a539d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:04.818161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b118a-73eb-41c8-8ec8-f24f6a539d66 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.818473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b118a-73eb-41c8-8ec8-f24f6a539d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.818741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b118a-73eb-41c8-8ec8-f24f6a539d66 None admin] PATH_INFO: `/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.832965 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b118a-73eb-41c8-8ec8-f24f6a539d66 None admin] RBAC: Authorizing `identity:get_user(user_id=014c5f64b9684a5185c3aa3e5fdb4aee)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:04.834465 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b118a-73eb-41c8-8ec8-f24f6a539d66 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:04.840453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 94/191] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:04 2022] GET /identity/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:04.840453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b118a-73eb-41c8-8ec8-f24f6a539d66 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:04.886436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:04.923713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffdefe-0621-48c1-9b73-5e85554cecb1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:04.940737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b118a-73eb-41c8-8ec8-f24f6a539d66 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:04.958195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870274d-ef5b-401f-9c4b-2c876bb9a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:04.959004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870274d-ef5b-401f-9c4b-2c876bb9a835 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.959291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870274d-ef5b-401f-9c4b-2c876bb9a835 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.959570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870274d-ef5b-401f-9c4b-2c876bb9a835 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.960735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870274d-ef5b-401f-9c4b-2c876bb9a835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:04.962171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870274d-ef5b-401f-9c4b-2c876bb9a835 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:04.963826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 98/192] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:04.964595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870274d-ef5b-401f-9c4b-2c876bb9a835 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:04.982387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457e93c-6ad2-4177-bc32-977c83f4a9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:04.982387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e93c-6ad2-4177-bc32-977c83f4a9dd None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:04.982647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e93c-6ad2-4177-bc32-977c83f4a9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:04.982775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e93c-6ad2-4177-bc32-977c83f4a9dd None admin] PATH_INFO: `/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:04.984034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457e93c-6ad2-4177-bc32-977c83f4a9dd None admin] RBAC: Authorizing `identity:get_user(user_id=014c5f64b9684a5185c3aa3e5fdb4aee)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:04.985483 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457e93c-6ad2-4177-bc32-977c83f4a9dd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:04.987185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 95/193] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:04 2022] GET /identity/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:04.987936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457e93c-6ad2-4177-bc32-977c83f4a9dd None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:05.018859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:05.082218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870274d-ef5b-401f-9c4b-2c876bb9a835 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:05.104928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457e93c-6ad2-4177-bc32-977c83f4a9dd None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:05.119172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8c0d-5294-4668-8e3f-c6205ade58a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:05.119830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8c0d-5294-4668-8e3f-c6205ade58a1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:05.120118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8c0d-5294-4668-8e3f-c6205ade58a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:05.120394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8c0d-5294-4668-8e3f-c6205ade58a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:05.122279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:05.145182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acdb3c-a2fb-49fa-bd71-883c2237e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:05.145859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acdb3c-a2fb-49fa-bd71-883c2237e149 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:05.146139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acdb3c-a2fb-49fa-bd71-883c2237e149 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:05.146462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acdb3c-a2fb-49fa-bd71-883c2237e149 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:05.147226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acdb3c-a2fb-49fa-bd71-883c2237e149 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:05.148732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acdb3c-a2fb-49fa-bd71-883c2237e149 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:05.169835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 96/194] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:19:04 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:19:05.176018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acdb3c-a2fb-49fa-bd71-883c2237e149 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:05.198865 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e8c0d-5294-4668-8e3f-c6205ade58a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:05.200601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e8c0d-5294-4668-8e3f-c6205ade58a1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:05.251425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:05.332584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 99/195] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:05.334779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acdb3c-a2fb-49fa-bd71-883c2237e149 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:05.337440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8c0d-5294-4668-8e3f-c6205ade58a1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:05.380453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a60c5-14e5-44ab-9237-ce37e7221324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:05.381919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a60c5-14e5-44ab-9237-ce37e7221324 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:05.382436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a60c5-14e5-44ab-9237-ce37e7221324 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:05.383285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a60c5-14e5-44ab-9237-ce37e7221324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:05.441191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:05.464992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8c0d-5294-4668-8e3f-c6205ade58a1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:05.485399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a60c5-14e5-44ab-9237-ce37e7221324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:05.487119 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a60c5-14e5-44ab-9237-ce37e7221324 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:05.509763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913876d9-4e29-429c-bfb3-651f3d689cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:05.511055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913876d9-4e29-429c-bfb3-651f3d689cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:05.511571 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913876d9-4e29-429c-bfb3-651f3d689cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:05.512024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913876d9-4e29-429c-bfb3-651f3d689cf6 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:05.513591 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913876d9-4e29-429c-bfb3-651f3d689cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:05.515150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913876d9-4e29-429c-bfb3-651f3d689cf6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:05.517245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 100/196] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:05 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:05.522756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913876d9-4e29-429c-bfb3-651f3d689cf6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:05.532455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:05.612576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 97/197] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:05.613724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a60c5-14e5-44ab-9237-ce37e7221324 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:05.648440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913876d9-4e29-429c-bfb3-651f3d689cf6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:05.684641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5dc2a-5f31-4ab0-a826-7b7b430c8e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:05.685302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5dc2a-5f31-4ab0-a826-7b7b430c8e27 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:05.686116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5dc2a-5f31-4ab0-a826-7b7b430c8e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:05.686419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5dc2a-5f31-4ab0-a826-7b7b430c8e27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:05.686797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:05.687261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5dc2a-5f31-4ab0-a826-7b7b430c8e27 None admin] RBAC: Adding query filter params (role.id=d3f29bc0265f45979298aa97cf42ee59, scope.project.id=f21952e768e3457caaf57d70eb4dc55f, user.id=014c5f64b9684a5185c3aa3e5fdb4aee) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:05.687570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5dc2a-5f31-4ab0-a826-7b7b430c8e27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:05.689013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5dc2a-5f31-4ab0-a826-7b7b430c8e27 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:05.696448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 101/198] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:05 2022] GET /identity/v3/role_assignments?user.id=014c5f64b9684a5185c3aa3e5fdb4aee&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=d3f29bc0265f45979298aa97cf42ee59 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:05.722163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a60c5-14e5-44ab-9237-ce37e7221324 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:05.737910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed374-a24a-4e04-849d-7f84492ed8bd None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:05.738492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed374-a24a-4e04-849d-7f84492ed8bd None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:05.738993 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed374-a24a-4e04-849d-7f84492ed8bd None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:05.740957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 102/199] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:05.746913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab3334-1f2b-40b1-bc01-61d244cb3b3d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:05.747422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab3334-1f2b-40b1-bc01-61d244cb3b3d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:05.747873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab3334-1f2b-40b1-bc01-61d244cb3b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:05.761968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588669c-995a-4df8-b37a-557b222a8ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:05.762906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588669c-995a-4df8-b37a-557b222a8ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:05.763192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588669c-995a-4df8-b37a-557b222a8ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:05.763471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588669c-995a-4df8-b37a-557b222a8ca9 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:05.765368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588669c-995a-4df8-b37a-557b222a8ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:05.766888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588669c-995a-4df8-b37a-557b222a8ca9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:05.768655 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 98/200] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:05 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:05.769901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-18ab3334-1f2b-40b1-bc01-61d244cb3b3d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:05.774377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-18ab3334-1f2b-40b1-bc01-61d244cb3b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:05.775500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588669c-995a-4df8-b37a-557b222a8ca9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:05.871961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:05.880517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 103/201] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:05.917676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab3334-1f2b-40b1-bc01-61d244cb3b3d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:05.970046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588669c-995a-4df8-b37a-557b222a8ca9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:06.034590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab3334-1f2b-40b1-bc01-61d244cb3b3d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:06.063622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48488b7-c112-4f8f-9e53-928ab75b262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:06.064296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48488b7-c112-4f8f-9e53-928ab75b262b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:06.064586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48488b7-c112-4f8f-9e53-928ab75b262b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:06.064858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48488b7-c112-4f8f-9e53-928ab75b262b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:06.065707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48488b7-c112-4f8f-9e53-928ab75b262b None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=f21952e768e3457caaf57d70eb4dc55f, user.id=014c5f64b9684a5185c3aa3e5fdb4aee) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:06.066020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48488b7-c112-4f8f-9e53-928ab75b262b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:06.067510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48488b7-c112-4f8f-9e53-928ab75b262b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:06.070896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbac10-ef65-4157-a178-7ee238d065c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:06.071772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbac10-ef65-4157-a178-7ee238d065c6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:06.072162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbac10-ef65-4157-a178-7ee238d065c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:06.072508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbac10-ef65-4157-a178-7ee238d065c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:06.084370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 99/202] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:05 2022] GET /identity/v3/role_assignments?user.id=014c5f64b9684a5185c3aa3e5fdb4aee&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:06.085463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbac10-ef65-4157-a178-7ee238d065c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-bcdbac10-ef65-4157-a178-7ee238d065c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:06.094414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:06.095584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:06.096558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:06.098996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 104/203] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:06.105175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48488b7-c112-4f8f-9e53-928ab75b262b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:06.109123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:06.221918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48488b7-c112-4f8f-9e53-928ab75b262b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:06.259624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb947e-4212-4fed-958c-5122f7298f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:06.260762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb947e-4212-4fed-958c-5122f7298f0b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:06.261247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb947e-4212-4fed-958c-5122f7298f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:06.261732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb947e-4212-4fed-958c-5122f7298f0b None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:06.262739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb947e-4212-4fed-958c-5122f7298f0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:06.263279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb947e-4212-4fed-958c-5122f7298f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:06.265490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb947e-4212-4fed-958c-5122f7298f0b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:06.275649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 100/204] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:06.282924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbac10-ef65-4157-a178-7ee238d065c6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:06.347229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:06.393543 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbac10-ef65-4157-a178-7ee238d065c6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:06.427689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea58a5-374c-40d2-8e4d-800bbad1d11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:06.428918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea58a5-374c-40d2-8e4d-800bbad1d11b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:06.429400 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea58a5-374c-40d2-8e4d-800bbad1d11b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:06.429965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea58a5-374c-40d2-8e4d-800bbad1d11b None admin] PATH_INFO: `/v3/users/dcce859b2c03445985c3a29b4b31405a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:06.431406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea58a5-374c-40d2-8e4d-800bbad1d11b None admin] RBAC: Authorizing `identity:get_user(user_id=dcce859b2c03445985c3a29b4b31405a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:06.433049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea58a5-374c-40d2-8e4d-800bbad1d11b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:06.434950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 105/205] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:06 2022] GET /identity/v3/users/dcce859b2c03445985c3a29b4b31405a => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:06.441364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb947e-4212-4fed-958c-5122f7298f0b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:06.513598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:06.553490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb947e-4212-4fed-958c-5122f7298f0b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:06.597217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a558c8-a3e4-439e-9f07-f9fce6f2b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:06.597879 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a558c8-a3e4-439e-9f07-f9fce6f2b9fd None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:06.598167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a558c8-a3e4-439e-9f07-f9fce6f2b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:06.598471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a558c8-a3e4-439e-9f07-f9fce6f2b9fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:06.671551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a558c8-a3e4-439e-9f07-f9fce6f2b9fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:06.673046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a558c8-a3e4-439e-9f07-f9fce6f2b9fd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:06.740205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:06.776933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 101/206] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:06.782378 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea58a5-374c-40d2-8e4d-800bbad1d11b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:06.906635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea58a5-374c-40d2-8e4d-800bbad1d11b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:06.938946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:06.951636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a2d26-bdc5-417a-80be-33d8784d3530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:06.952861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a2d26-bdc5-417a-80be-33d8784d3530 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:06.953567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a2d26-bdc5-417a-80be-33d8784d3530 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:06.953849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a2d26-bdc5-417a-80be-33d8784d3530 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:06.955080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a2d26-bdc5-417a-80be-33d8784d3530 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:06.956541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a2d26-bdc5-417a-80be-33d8784d3530 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:06.958573 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 106/207] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:06 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:06.964084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a558c8-a3e4-439e-9f07-f9fce6f2b9fd None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:07.129149 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a558c8-a3e4-439e-9f07-f9fce6f2b9fd None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:07.173171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1518f43-cdcc-4e6d-92aa-0b22a1cff48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:07.173827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1518f43-cdcc-4e6d-92aa-0b22a1cff48b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:07.174106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1518f43-cdcc-4e6d-92aa-0b22a1cff48b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:07.174394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1518f43-cdcc-4e6d-92aa-0b22a1cff48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:07.175233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1518f43-cdcc-4e6d-92aa-0b22a1cff48b None admin] RBAC: Adding query filter params (role.id=1cfde5f2028c4ee8aa20c8665a6078e3, scope.project.id=0de6538741964c2b8766be7436e4800e, user.id=dcce859b2c03445985c3a29b4b31405a) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:07.175541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1518f43-cdcc-4e6d-92aa-0b22a1cff48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:07.177234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1518f43-cdcc-4e6d-92aa-0b22a1cff48b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:07.183835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 102/208] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:06 2022] GET /identity/v3/role_assignments?user.id=dcce859b2c03445985c3a29b4b31405a&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=1cfde5f2028c4ee8aa20c8665a6078e3 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:07.704159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4cb97-4b42-41cd-a234-0cb74018f660 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:07.704671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4cb97-4b42-41cd-a234-0cb74018f660 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:07.704772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4cb97-4b42-41cd-a234-0cb74018f660 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:07.706168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 107/209] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:07.716038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf26c8-909b-4d92-9274-10049718c9c4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:07.716563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf26c8-909b-4d92-9274-10049718c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:07.716563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf26c8-909b-4d92-9274-10049718c9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:07.739369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-aebf26c8-909b-4d92-9274-10049718c9c4 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:07.740551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-aebf26c8-909b-4d92-9274-10049718c9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:07.776321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:07.826949 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 103/210] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:07.850419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4cb97-4b42-41cd-a234-0cb74018f660 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:07.959814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4cb97-4b42-41cd-a234-0cb74018f660 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:07.994993 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bfa24-078f-407c-839a-e0986ebb058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:07.995788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bfa24-078f-407c-839a-e0986ebb058d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:07.996073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bfa24-078f-407c-839a-e0986ebb058d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:07.996351 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bfa24-078f-407c-839a-e0986ebb058d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.006807 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bfa24-078f-407c-839a-e0986ebb058d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-034bfa24-078f-407c-839a-e0986ebb058d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:08.014498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:08.015373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:08.016164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 108/211] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:08.021901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf26c8-909b-4d92-9274-10049718c9c4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:08.026326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766491c-9956-416e-aec5-095e8917dbe0 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.026889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766491c-9956-416e-aec5-095e8917dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.027375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766491c-9956-416e-aec5-095e8917dbe0 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.028944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 109/212] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:19:08.036798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21782890-d62f-49a1-8717-da593c91b6ec None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.037631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21782890-d62f-49a1-8717-da593c91b6ec None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.038138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21782890-d62f-49a1-8717-da593c91b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.061527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-21782890-d62f-49a1-8717-da593c91b6ec None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:08.063094 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-21782890-d62f-49a1-8717-da593c91b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:08.122458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:08.133397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf26c8-909b-4d92-9274-10049718c9c4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:08.140913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 110/213] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:08.163346 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21782890-d62f-49a1-8717-da593c91b6ec None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:08.174557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85afd04-5212-4d4e-b218-cd4fe74bff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:08.175254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85afd04-5212-4d4e-b218-cd4fe74bff2b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.175965 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85afd04-5212-4d4e-b218-cd4fe74bff2b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.176514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85afd04-5212-4d4e-b218-cd4fe74bff2b None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.179161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85afd04-5212-4d4e-b218-cd4fe74bff2b None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:08.179475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85afd04-5212-4d4e-b218-cd4fe74bff2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:08.181011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85afd04-5212-4d4e-b218-cd4fe74bff2b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:08.190149 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 104/214] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:08.195827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85afd04-5212-4d4e-b218-cd4fe74bff2b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:08.219718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:08.292310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21782890-d62f-49a1-8717-da593c91b6ec None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:08.302768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85afd04-5212-4d4e-b218-cd4fe74bff2b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:08.330606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a869f3-cfc0-4e60-988a-1c763a5ec145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:08.331417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a869f3-cfc0-4e60-988a-1c763a5ec145 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.331709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a869f3-cfc0-4e60-988a-1c763a5ec145 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.331968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a869f3-cfc0-4e60-988a-1c763a5ec145 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.337099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d17f4d-9076-4238-9f13-52825bf2cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:08.337974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d17f4d-9076-4238-9f13-52825bf2cb9c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.338273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d17f4d-9076-4238-9f13-52825bf2cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.338563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d17f4d-9076-4238-9f13-52825bf2cb9c None admin] PATH_INFO: `/v3/users/cba607f3a40b4dc09dd0e6444dd76280` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.343877 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a869f3-cfc0-4e60-988a-1c763a5ec145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-50a869f3-cfc0-4e60-988a-1c763a5ec145 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:08.351930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:08.353056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:08.354514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 111/215] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:08.355181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d91a-9114-4d9f-b22f-5ad819dc16da None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.355181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d91a-9114-4d9f-b22f-5ad819dc16da None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.355297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d91a-9114-4d9f-b22f-5ad819dc16da None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.356670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 112/216] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:08.359432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d17f4d-9076-4238-9f13-52825bf2cb9c None admin] RBAC: Authorizing `identity:get_user(user_id=cba607f3a40b4dc09dd0e6444dd76280)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:08.361165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d17f4d-9076-4238-9f13-52825bf2cb9c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:08.361270 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1d91a-9114-4d9f-b22f-5ad819dc16da None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:08.367392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 105/217] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:08 2022] GET /identity/v3/users/cba607f3a40b4dc09dd0e6444dd76280 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:08.367392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11431-dde7-485d-a7fb-59ae336b47b3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.367392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11431-dde7-485d-a7fb-59ae336b47b3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.367392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11431-dde7-485d-a7fb-59ae336b47b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.382485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b8e11431-dde7-485d-a7fb-59ae336b47b3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:08.383902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b8e11431-dde7-485d-a7fb-59ae336b47b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:08.415156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:08.463305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 106/218] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:08.470650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e11431-dde7-485d-a7fb-59ae336b47b3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:08.478516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:08.481721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1d91a-9114-4d9f-b22f-5ad819dc16da None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:08.516834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b04e89-2f56-4a1c-b144-23eb5a969b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:08.517499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b04e89-2f56-4a1c-b144-23eb5a969b14 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.517792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b04e89-2f56-4a1c-b144-23eb5a969b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.518062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b04e89-2f56-4a1c-b144-23eb5a969b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.518836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b04e89-2f56-4a1c-b144-23eb5a969b14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:08.519145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b04e89-2f56-4a1c-b144-23eb5a969b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:08.520544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b04e89-2f56-4a1c-b144-23eb5a969b14 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:08.529802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 113/219] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:08.530553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b04e89-2f56-4a1c-b144-23eb5a969b14 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:08.589841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e11431-dde7-485d-a7fb-59ae336b47b3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:08.624867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43edf14-e7c0-4d7e-93a1-3432a6c4719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:08.625757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43edf14-e7c0-4d7e-93a1-3432a6c4719b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.626040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43edf14-e7c0-4d7e-93a1-3432a6c4719b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.626319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43edf14-e7c0-4d7e-93a1-3432a6c4719b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.636301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b04e89-2f56-4a1c-b144-23eb5a969b14 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:08.646877 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:08.677219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49129aed-c014-4af7-9aa3-fcd08d92865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:08.678012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129aed-c014-4af7-9aa3-fcd08d92865f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.678300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129aed-c014-4af7-9aa3-fcd08d92865f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.678613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49129aed-c014-4af7-9aa3-fcd08d92865f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.679799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49129aed-c014-4af7-9aa3-fcd08d92865f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:08.681243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49129aed-c014-4af7-9aa3-fcd08d92865f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:08.682912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 114/220] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:08.683678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49129aed-c014-4af7-9aa3-fcd08d92865f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:08.700491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43edf14-e7c0-4d7e-93a1-3432a6c4719b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:08.702573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43edf14-e7c0-4d7e-93a1-3432a6c4719b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:08.712245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:08.783479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49129aed-c014-4af7-9aa3-fcd08d92865f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:08.800612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 107/221] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:08.802201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c795a-79fd-4289-ad47-93dc334382ae None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.802520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c795a-79fd-4289-ad47-93dc334382ae None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.802801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c795a-79fd-4289-ad47-93dc334382ae None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.804083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 108/222] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:08.804771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c795a-79fd-4289-ad47-93dc334382ae None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:08.819618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb637-5f53-4e6c-9338-70af78b40497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:08.820491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb637-5f53-4e6c-9338-70af78b40497 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.820774 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb637-5f53-4e6c-9338-70af78b40497 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.821057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb637-5f53-4e6c-9338-70af78b40497 None admin] PATH_INFO: `/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.822239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bb637-5f53-4e6c-9338-70af78b40497 None admin] RBAC: Authorizing `identity:get_user(user_id=014c5f64b9684a5185c3aa3e5fdb4aee)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:08.823714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bb637-5f53-4e6c-9338-70af78b40497 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:08.825344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 115/223] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:08 2022] GET /identity/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:08.826689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb637-5f53-4e6c-9338-70af78b40497 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:08.871451 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:08.904767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c795a-79fd-4289-ad47-93dc334382ae None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:08.913872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:08.923943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb637-5f53-4e6c-9338-70af78b40497 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:08.938999 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251046-aa12-4cd6-9c4d-f2469107aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:08.939657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251046-aa12-4cd6-9c4d-f2469107aa26 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.939945 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251046-aa12-4cd6-9c4d-f2469107aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.940215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251046-aa12-4cd6-9c4d-f2469107aa26 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.940914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb251046-aa12-4cd6-9c4d-f2469107aa26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:08.942335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb251046-aa12-4cd6-9c4d-f2469107aa26 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:08.957851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3552156-f1a1-4631-a487-8504486abbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:08.958726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3552156-f1a1-4631-a487-8504486abbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.959010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3552156-f1a1-4631-a487-8504486abbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.959285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3552156-f1a1-4631-a487-8504486abbe9 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.960455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3552156-f1a1-4631-a487-8504486abbe9 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:08.961875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3552156-f1a1-4631-a487-8504486abbe9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:08.962396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 109/224] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:19:08 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:19:08.963604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 116/225] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:08 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:08.963604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3552156-f1a1-4631-a487-8504486abbe9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:08.975983 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca416c-8710-474d-89e8-28242a84c9b1 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:08.976328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca416c-8710-474d-89e8-28242a84c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:08.976612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca416c-8710-474d-89e8-28242a84c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:08.995804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-17ca416c-8710-474d-89e8-28242a84c9b1 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:08.997036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-17ca416c-8710-474d-89e8-28242a84c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:09.077547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 110/226] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:09.086545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3552156-f1a1-4631-a487-8504486abbe9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:09.087786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca416c-8710-474d-89e8-28242a84c9b1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:09.101796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:09.125574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fcc57-004a-4cc9-ae34-2c151b795d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:09.126546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fcc57-004a-4cc9-ae34-2c151b795d57 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:09.126829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fcc57-004a-4cc9-ae34-2c151b795d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:09.127106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fcc57-004a-4cc9-ae34-2c151b795d57 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:09.129563 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fcc57-004a-4cc9-ae34-2c151b795d57 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:09.129755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fcc57-004a-4cc9-ae34-2c151b795d57 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:09.134912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 117/227] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:08 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:09.134912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fcc57-004a-4cc9-ae34-2c151b795d57 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:09.211377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:09.220835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca416c-8710-474d-89e8-28242a84c9b1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:09.262192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fcc57-004a-4cc9-ae34-2c151b795d57 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:09.265819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2a1e-f30c-4167-add8-7ec15e4788b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:09.266518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2a1e-f30c-4167-add8-7ec15e4788b8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:09.266808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2a1e-f30c-4167-add8-7ec15e4788b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:09.267088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2a1e-f30c-4167-add8-7ec15e4788b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:09.268316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c2a1e-f30c-4167-add8-7ec15e4788b8 None admin] RBAC: Adding query filter params (role.id=6c516ab551054fc8bd24c92c7d9173ba, scope.project.id=f21952e768e3457caaf57d70eb4dc55f, user.id=cba607f3a40b4dc09dd0e6444dd76280) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:09.268316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c2a1e-f30c-4167-add8-7ec15e4788b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:09.269674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c2a1e-f30c-4167-add8-7ec15e4788b8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:09.278150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 111/228] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:09 2022] GET /identity/v3/role_assignments?user.id=cba607f3a40b4dc09dd0e6444dd76280&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:09.278817 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2a1e-f30c-4167-add8-7ec15e4788b8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:09.318610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d262a0-ddc5-451c-b20b-d7e58802f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:09.319488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d262a0-ddc5-451c-b20b-d7e58802f71a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:09.319773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d262a0-ddc5-451c-b20b-d7e58802f71a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:09.320594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d262a0-ddc5-451c-b20b-d7e58802f71a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:09.337066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d262a0-ddc5-451c-b20b-d7e58802f71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-15d262a0-ddc5-451c-b20b-d7e58802f71a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:09.347983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:09.348939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:09.349728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 118/229] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:19:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:09.359906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d262a0-ddc5-451c-b20b-d7e58802f71a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:09.411203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:09.425457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2a1e-f30c-4167-add8-7ec15e4788b8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:09.467872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5252b-76dc-4f8c-9ea3-7461fe1e3901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:09.468688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5252b-76dc-4f8c-9ea3-7461fe1e3901 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:09.468973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5252b-76dc-4f8c-9ea3-7461fe1e3901 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:09.469251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5252b-76dc-4f8c-9ea3-7461fe1e3901 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f/users/014c5f64b9684a5185c3aa3e5fdb4aee/roles/d3f29bc0265f45979298aa97cf42ee59` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:09.471824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5252b-76dc-4f8c-9ea3-7461fe1e3901 None admin] RBAC: Authorizing `identity:create_grant(project_id=f21952e768e3457caaf57d70eb4dc55f, user_id=014c5f64b9684a5185c3aa3e5fdb4aee, role_id=d3f29bc0265f45979298aa97cf42ee59)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:09.473941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5252b-76dc-4f8c-9ea3-7461fe1e3901 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:09.492252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 112/230] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:19:09 2022] PUT /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f/users/014c5f64b9684a5185c3aa3e5fdb4aee/roles/d3f29bc0265f45979298aa97cf42ee59 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:09.536159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d262a0-ddc5-451c-b20b-d7e58802f71a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:09.610294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a072bfb-08e2-4fc9-aeb0-3f6193cb6abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:09.611016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a072bfb-08e2-4fc9-aeb0-3f6193cb6abc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:09.611305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a072bfb-08e2-4fc9-aeb0-3f6193cb6abc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:09.611587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a072bfb-08e2-4fc9-aeb0-3f6193cb6abc None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:09.612364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a072bfb-08e2-4fc9-aeb0-3f6193cb6abc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:09.612675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a072bfb-08e2-4fc9-aeb0-3f6193cb6abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:09.614107 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a072bfb-08e2-4fc9-aeb0-3f6193cb6abc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:09.626547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 119/231] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:09.631823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5252b-76dc-4f8c-9ea3-7461fe1e3901 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:09.651819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:09.762026 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5252b-76dc-4f8c-9ea3-7461fe1e3901 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:09.803290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d82c0-b2ed-429a-ba72-a3dd1e76208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:09.804256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d82c0-b2ed-429a-ba72-a3dd1e76208c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:09.804568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d82c0-b2ed-429a-ba72-a3dd1e76208c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:09.804716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d82c0-b2ed-429a-ba72-a3dd1e76208c None admin] PATH_INFO: `/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:09.805926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d82c0-b2ed-429a-ba72-a3dd1e76208c None admin] RBAC: Authorizing `identity:get_user(user_id=014c5f64b9684a5185c3aa3e5fdb4aee)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:09.807417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d82c0-b2ed-429a-ba72-a3dd1e76208c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:09.809358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 113/232] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:09 2022] GET /identity/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:09.814929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a072bfb-08e2-4fc9-aeb0-3f6193cb6abc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:09.932523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a072bfb-08e2-4fc9-aeb0-3f6193cb6abc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:09.934368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:09.988453 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232c286-81b8-4341-adad-74240c5c78d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:09.989336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232c286-81b8-4341-adad-74240c5c78d8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:09.989627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232c286-81b8-4341-adad-74240c5c78d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:09.989908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232c286-81b8-4341-adad-74240c5c78d8 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:09.995155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232c286-81b8-4341-adad-74240c5c78d8 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:09.996629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232c286-81b8-4341-adad-74240c5c78d8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:09.998700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 120/233] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:09 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:10.004164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d82c0-b2ed-429a-ba72-a3dd1e76208c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:10.124906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:10.142953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d82c0-b2ed-429a-ba72-a3dd1e76208c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:10.197575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecdceb-66a9-4fe6-94b5-64856f001a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:10.198723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecdceb-66a9-4fe6-94b5-64856f001a2a None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:10.199013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecdceb-66a9-4fe6-94b5-64856f001a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:10.199296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecdceb-66a9-4fe6-94b5-64856f001a2a None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f/users/014c5f64b9684a5185c3aa3e5fdb4aee/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:10.201917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecdceb-66a9-4fe6-94b5-64856f001a2a None admin] RBAC: Authorizing `identity:create_grant(project_id=f21952e768e3457caaf57d70eb4dc55f, user_id=014c5f64b9684a5185c3aa3e5fdb4aee, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:10.203492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecdceb-66a9-4fe6-94b5-64856f001a2a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:10.222163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 114/234] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:19:10 2022] PUT /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f/users/014c5f64b9684a5185c3aa3e5fdb4aee/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:11.690548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef03a8e-385a-4630-a33a-84d2e6f5f0b5 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:11.691576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef03a8e-385a-4630-a33a-84d2e6f5f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:11.692063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef03a8e-385a-4630-a33a-84d2e6f5f0b5 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:11.693663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 121/235] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:11.698975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052d353-30c4-47b9-86d5-5dfee7545100 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:11.699766 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052d353-30c4-47b9-86d5-5dfee7545100 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:11.700297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052d353-30c4-47b9-86d5-5dfee7545100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:11.723388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a052d353-30c4-47b9-86d5-5dfee7545100 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:11.724958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a052d353-30c4-47b9-86d5-5dfee7545100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:11.731316 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745d2a0-bdd5-4d6c-96b1-910bd2c1a08b None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:11.731894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745d2a0-bdd5-4d6c-96b1-910bd2c1a08b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:11.732954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745d2a0-bdd5-4d6c-96b1-910bd2c1a08b None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:11.734842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 122/236] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:11.740705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67e59-89b1-4e9d-a73b-905c8538b71f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:11.741404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67e59-89b1-4e9d-a73b-905c8538b71f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:11.742052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67e59-89b1-4e9d-a73b-905c8538b71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:11.782723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e5e67e59-89b1-4e9d-a73b-905c8538b71f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:11.786180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e5e67e59-89b1-4e9d-a73b-905c8538b71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:11.825191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 115/237] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:11.826589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e8bb-248d-4b4d-85b1-787b74546717 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:11.826885 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e8bb-248d-4b4d-85b1-787b74546717 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:11.827167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e8bb-248d-4b4d-85b1-787b74546717 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:11.828443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 116/238] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:11.833844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ab597-db58-414d-b581-e9e327028eea None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:11.834293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ab597-db58-414d-b581-e9e327028eea None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:11.834735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ab597-db58-414d-b581-e9e327028eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:11.852778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-995ab597-db58-414d-b581-e9e327028eea None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:11.854222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-995ab597-db58-414d-b581-e9e327028eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:11.905740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 123/239] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:11.906917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e67e59-89b1-4e9d-a73b-905c8538b71f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:11.952863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 117/240] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:11.952863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ab597-db58-414d-b581-e9e327028eea None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:11.970730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:12.043342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:12.046810 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e67e59-89b1-4e9d-a73b-905c8538b71f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:12.072962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ab597-db58-414d-b581-e9e327028eea None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:12.085816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007feaf9-da53-41a6-8690-9a04ff6a285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:12.086969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007feaf9-da53-41a6-8690-9a04ff6a285c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.087406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007feaf9-da53-41a6-8690-9a04ff6a285c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.087810 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007feaf9-da53-41a6-8690-9a04ff6a285c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.089145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007feaf9-da53-41a6-8690-9a04ff6a285c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:12.090975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007feaf9-da53-41a6-8690-9a04ff6a285c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:12.093826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 124/241] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:12.095000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007feaf9-da53-41a6-8690-9a04ff6a285c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:12.118100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbcfb4-c361-4bdd-9f90-1278d7c3aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:12.119238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbcfb4-c361-4bdd-9f90-1278d7c3aa7f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.119693 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbcfb4-c361-4bdd-9f90-1278d7c3aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.120171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbcfb4-c361-4bdd-9f90-1278d7c3aa7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.132518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbcfb4-c361-4bdd-9f90-1278d7c3aa7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d7cbcfb4-c361-4bdd-9f90-1278d7c3aa7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:12.141782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:12.142774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:12.143757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:12.146248 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 118/242] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:12.147298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbcfb4-c361-4bdd-9f90-1278d7c3aa7f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:12.210410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007feaf9-da53-41a6-8690-9a04ff6a285c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:12.220412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:12.250386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b98f0b-04b8-4ab6-b59d-d25b346742a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:12.251502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b98f0b-04b8-4ab6-b59d-d25b346742a0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.251973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b98f0b-04b8-4ab6-b59d-d25b346742a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.252494 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b98f0b-04b8-4ab6-b59d-d25b346742a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.261910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbcfb4-c361-4bdd-9f90-1278d7c3aa7f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:12.264509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b98f0b-04b8-4ab6-b59d-d25b346742a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-f4b98f0b-04b8-4ab6-b59d-d25b346742a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:12.272921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:12.274032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:12.274889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:12.277021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 125/243] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:12.278074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b98f0b-04b8-4ab6-b59d-d25b346742a0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:12.306010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6c187-e08a-4bd4-a7a1-5e540de1968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:12.306821 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6c187-e08a-4bd4-a7a1-5e540de1968f None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.307017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6c187-e08a-4bd4-a7a1-5e540de1968f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.307349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6c187-e08a-4bd4-a7a1-5e540de1968f None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.308016 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6c187-e08a-4bd4-a7a1-5e540de1968f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:12.309494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6c187-e08a-4bd4-a7a1-5e540de1968f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:12.317698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:12.337225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 119/244] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:19:12 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:19:12.343463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6c187-e08a-4bd4-a7a1-5e540de1968f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:12.429608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b98f0b-04b8-4ab6-b59d-d25b346742a0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:12.473959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8b756-67ba-43b3-a0f8-c58dfa490d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:12.475016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8b756-67ba-43b3-a0f8-c58dfa490d90 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.476136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8b756-67ba-43b3-a0f8-c58dfa490d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.476655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8b756-67ba-43b3-a0f8-c58dfa490d90 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.477642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8b756-67ba-43b3-a0f8-c58dfa490d90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:12.478164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8b756-67ba-43b3-a0f8-c58dfa490d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:12.480200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8b756-67ba-43b3-a0f8-c58dfa490d90 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:12.491696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 126/245] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:12.499937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8b756-67ba-43b3-a0f8-c58dfa490d90 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:12.577531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6c187-e08a-4bd4-a7a1-5e540de1968f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:12.604795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:12.620076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b273e13-c4c2-4f55-8944-3c6506057f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:12.620747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b273e13-c4c2-4f55-8944-3c6506057f1b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.621029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b273e13-c4c2-4f55-8944-3c6506057f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.621303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b273e13-c4c2-4f55-8944-3c6506057f1b None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.622052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b273e13-c4c2-4f55-8944-3c6506057f1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:12.622405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b273e13-c4c2-4f55-8944-3c6506057f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:12.624611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b273e13-c4c2-4f55-8944-3c6506057f1b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:12.634603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 120/246] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:12.640619 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b273e13-c4c2-4f55-8944-3c6506057f1b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:12.706212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:12.720650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8b756-67ba-43b3-a0f8-c58dfa490d90 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:12.767055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b273e13-c4c2-4f55-8944-3c6506057f1b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:12.768030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb229bf-63a9-4b82-9291-2d283d993aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:12.768922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb229bf-63a9-4b82-9291-2d283d993aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.769202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb229bf-63a9-4b82-9291-2d283d993aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.769479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb229bf-63a9-4b82-9291-2d283d993aa0 None admin] PATH_INFO: `/v3/users/cba607f3a40b4dc09dd0e6444dd76280` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.770849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb229bf-63a9-4b82-9291-2d283d993aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=cba607f3a40b4dc09dd0e6444dd76280)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:12.772332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb229bf-63a9-4b82-9291-2d283d993aa0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:12.773983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 127/247] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:12 2022] GET /identity/v3/users/cba607f3a40b4dc09dd0e6444dd76280 => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:12.780308 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81be789-8700-4615-875d-e94d9767d07e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.780631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81be789-8700-4615-875d-e94d9767d07e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.780912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81be789-8700-4615-875d-e94d9767d07e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.782228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 128/248] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:12.782999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81be789-8700-4615-875d-e94d9767d07e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:12.808752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dedb9-4ca3-48a4-aa84-3c459f31f454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:12.809937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dedb9-4ca3-48a4-aa84-3c459f31f454 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.810461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dedb9-4ca3-48a4-aa84-3c459f31f454 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.810907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dedb9-4ca3-48a4-aa84-3c459f31f454 None admin] PATH_INFO: `/v3/users/64a7100c20634d64ba13149226f2e07f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.825258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dedb9-4ca3-48a4-aa84-3c459f31f454 None admin] RBAC: Authorizing `identity:get_user(user_id=64a7100c20634d64ba13149226f2e07f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:12.827517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dedb9-4ca3-48a4-aa84-3c459f31f454 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:12.829399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 121/249] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:12 2022] GET /identity/v3/users/64a7100c20634d64ba13149226f2e07f => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:12.830788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abfcb0-e5f7-4536-8ce1-cf3d0a6fa357 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.831240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abfcb0-e5f7-4536-8ce1-cf3d0a6fa357 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.831650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abfcb0-e5f7-4536-8ce1-cf3d0a6fa357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.849897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-14abfcb0-e5f7-4536-8ce1-cf3d0a6fa357 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:12.851391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-14abfcb0-e5f7-4536-8ce1-cf3d0a6fa357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:12.891059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:12.908856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81be789-8700-4615-875d-e94d9767d07e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:12.937254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 122/250] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:12.938940 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abfcb0-e5f7-4536-8ce1-cf3d0a6fa357 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:12.959819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddfcec-2439-4c42-aad6-49cd35e8b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:12.960836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfcec-2439-4c42-aad6-49cd35e8b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:12.961217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfcec-2439-4c42-aad6-49cd35e8b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:12.961849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfcec-2439-4c42-aad6-49cd35e8b0d6 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:12.963779 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddfcec-2439-4c42-aad6-49cd35e8b0d6 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:12.965918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddfcec-2439-4c42-aad6-49cd35e8b0d6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:12.968884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 129/251] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:12 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:12.975074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddfcec-2439-4c42-aad6-49cd35e8b0d6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:13.014455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:13.081322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddfcec-2439-4c42-aad6-49cd35e8b0d6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:13.110011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abfcb0-e5f7-4536-8ce1-cf3d0a6fa357 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:13.116169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa48af7-6664-46bc-89fc-7188d8e28435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:13.117129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48af7-6664-46bc-89fc-7188d8e28435 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:13.117413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48af7-6664-46bc-89fc-7188d8e28435 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:13.117737 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48af7-6664-46bc-89fc-7188d8e28435 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f/users/cba607f3a40b4dc09dd0e6444dd76280/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:13.119798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa48af7-6664-46bc-89fc-7188d8e28435 None admin] RBAC: Authorizing `identity:create_grant(project_id=f21952e768e3457caaf57d70eb4dc55f, user_id=cba607f3a40b4dc09dd0e6444dd76280, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:13.121358 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa48af7-6664-46bc-89fc-7188d8e28435 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:13.140596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 130/252] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:19:12 2022] PUT /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f/users/cba607f3a40b4dc09dd0e6444dd76280/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:13.141848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa48af7-6664-46bc-89fc-7188d8e28435 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:13.161168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7ae86-a045-4501-b61f-36c263baca2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:13.162229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ae86-a045-4501-b61f-36c263baca2b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:13.162740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ae86-a045-4501-b61f-36c263baca2b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:13.163243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ae86-a045-4501-b61f-36c263baca2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:13.230177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:13.295079 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7ae86-a045-4501-b61f-36c263baca2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:13.298293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7ae86-a045-4501-b61f-36c263baca2b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:13.336032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:13.355466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa48af7-6664-46bc-89fc-7188d8e28435 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:13.395450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d912a-40a8-4bcb-9b23-e4575eeba612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:13.396893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d912a-40a8-4bcb-9b23-e4575eeba612 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:13.397373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d912a-40a8-4bcb-9b23-e4575eeba612 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:13.398084 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d912a-40a8-4bcb-9b23-e4575eeba612 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:13.411966 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d912a-40a8-4bcb-9b23-e4575eeba612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-835d912a-40a8-4bcb-9b23-e4575eeba612 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:13.422835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:13.423726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:13.424536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:13.428021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 131/253] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:13.429706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65675a7-7ce0-4d4d-aa85-12f12a68aa79 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:13.430607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65675a7-7ce0-4d4d-aa85-12f12a68aa79 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:13.431354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65675a7-7ce0-4d4d-aa85-12f12a68aa79 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:13.433087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 132/254] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:13.434460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65675a7-7ce0-4d4d-aa85-12f12a68aa79 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:13.443401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 123/255] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:13.444785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b364d-385f-4249-b96a-4f07bbb10ab8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:13.445081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b364d-385f-4249-b96a-4f07bbb10ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:13.445358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b364d-385f-4249-b96a-4f07bbb10ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:13.476538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dd0b364d-385f-4249-b96a-4f07bbb10ab8 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:13.477799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dd0b364d-385f-4249-b96a-4f07bbb10ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:13.609880 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 124/256] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:13.611872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b364d-385f-4249-b96a-4f07bbb10ab8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:13.618369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:13.703118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65675a7-7ce0-4d4d-aa85-12f12a68aa79 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:13.765585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b364d-385f-4249-b96a-4f07bbb10ab8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:13.780198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f7951-ec08-421f-a4c5-8aee9200c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:13.781484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7951-ec08-421f-a4c5-8aee9200c059 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:13.781962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7951-ec08-421f-a4c5-8aee9200c059 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:13.782457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7951-ec08-421f-a4c5-8aee9200c059 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:13.783398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f7951-ec08-421f-a4c5-8aee9200c059 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:13.783895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f7951-ec08-421f-a4c5-8aee9200c059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:13.785498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f7951-ec08-421f-a4c5-8aee9200c059 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:13.797207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 133/257] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:13.798246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f7951-ec08-421f-a4c5-8aee9200c059 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:13.807009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389ee5f-ec6f-4c8b-a679-7c4da06131d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:13.807878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389ee5f-ec6f-4c8b-a679-7c4da06131d0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:13.808168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389ee5f-ec6f-4c8b-a679-7c4da06131d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:13.808449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389ee5f-ec6f-4c8b-a679-7c4da06131d0 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:13.813065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389ee5f-ec6f-4c8b-a679-7c4da06131d0 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:13.814570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389ee5f-ec6f-4c8b-a679-7c4da06131d0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:13.818870 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 125/258] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:13 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:13.819659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389ee5f-ec6f-4c8b-a679-7c4da06131d0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:13.824705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:13.907099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:13.958854 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389ee5f-ec6f-4c8b-a679-7c4da06131d0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:14.011495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c81cd-416a-478c-8c35-34af51f614c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:14.013028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c81cd-416a-478c-8c35-34af51f614c9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:14.014066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c81cd-416a-478c-8c35-34af51f614c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:14.014615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c81cd-416a-478c-8c35-34af51f614c9 None admin] PATH_INFO: `/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:14.020566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c81cd-416a-478c-8c35-34af51f614c9 None admin] RBAC: Authorizing `identity:get_user(user_id=014c5f64b9684a5185c3aa3e5fdb4aee)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:14.022286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c81cd-416a-478c-8c35-34af51f614c9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:14.027227 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 126/259] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:13 2022] GET /identity/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:14.030763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c81cd-416a-478c-8c35-34af51f614c9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:14.062886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f7951-ec08-421f-a4c5-8aee9200c059 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:14.139254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953254-6db8-478e-a3b4-74f38042ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:14.140051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953254-6db8-478e-a3b4-74f38042ddfa None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:14.140338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953254-6db8-478e-a3b4-74f38042ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:14.140618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953254-6db8-478e-a3b4-74f38042ddfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:14.163827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a953254-6db8-478e-a3b4-74f38042ddfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-9a953254-6db8-478e-a3b4-74f38042ddfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:14.180701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:14.181574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:14.182463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:14.186831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 134/260] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:19:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:14.187660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953254-6db8-478e-a3b4-74f38042ddfa None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:14.209717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c81cd-416a-478c-8c35-34af51f614c9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:14.279725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:14.315614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953254-6db8-478e-a3b4-74f38042ddfa None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:14.323052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b695a4-7d61-42b2-b2b5-64a9849ef24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:14.323734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b695a4-7d61-42b2-b2b5-64a9849ef24b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:14.324020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b695a4-7d61-42b2-b2b5-64a9849ef24b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:14.324304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b695a4-7d61-42b2-b2b5-64a9849ef24b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:14.325151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b695a4-7d61-42b2-b2b5-64a9849ef24b None admin] RBAC: Adding query filter params (role.id=1cfde5f2028c4ee8aa20c8665a6078e3, scope.project.id=f21952e768e3457caaf57d70eb4dc55f, user.id=64a7100c20634d64ba13149226f2e07f) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:14.325468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b695a4-7d61-42b2-b2b5-64a9849ef24b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:14.327078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b695a4-7d61-42b2-b2b5-64a9849ef24b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:14.347198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 127/261] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:14 2022] GET /identity/v3/role_assignments?user.id=64a7100c20634d64ba13149226f2e07f&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=1cfde5f2028c4ee8aa20c8665a6078e3 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:14.348265 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b695a4-7d61-42b2-b2b5-64a9849ef24b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:14.350596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae48a9-78b5-49e1-b06d-b3b3b5c2c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:14.351352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae48a9-78b5-49e1-b06d-b3b3b5c2c4fa None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:14.351811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:14.351913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae48a9-78b5-49e1-b06d-b3b3b5c2c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:14.352092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae48a9-78b5-49e1-b06d-b3b3b5c2c4fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:14.433118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae48a9-78b5-49e1-b06d-b3b3b5c2c4fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:14.434627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae48a9-78b5-49e1-b06d-b3b3b5c2c4fa None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:14.578797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:14.642894 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b695a4-7d61-42b2-b2b5-64a9849ef24b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:14.650812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 135/262] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:14.659425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae48a9-78b5-49e1-b06d-b3b3b5c2c4fa None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:14.714898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905c6e0-2fc9-429d-9daa-61852ff0b0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:14.715574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c6e0-2fc9-429d-9daa-61852ff0b0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:14.715862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c6e0-2fc9-429d-9daa-61852ff0b0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:14.716675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c6e0-2fc9-429d-9daa-61852ff0b0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:14.717447 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905c6e0-2fc9-429d-9daa-61852ff0b0b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:14.717757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905c6e0-2fc9-429d-9daa-61852ff0b0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:14.719167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905c6e0-2fc9-429d-9daa-61852ff0b0b6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:14.740344 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 128/263] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:14.746219 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905c6e0-2fc9-429d-9daa-61852ff0b0b6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:14.818021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae48a9-78b5-49e1-b06d-b3b3b5c2c4fa None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:14.856374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6916b8-8c52-443d-918b-82f70bba95c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:14.857719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6916b8-8c52-443d-918b-82f70bba95c0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:14.858003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6916b8-8c52-443d-918b-82f70bba95c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:14.858278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6916b8-8c52-443d-918b-82f70bba95c0 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:14.862701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:14.867170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6916b8-8c52-443d-918b-82f70bba95c0 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:14.868861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6916b8-8c52-443d-918b-82f70bba95c0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:14.873775 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 136/264] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:14 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:14.879083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6916b8-8c52-443d-918b-82f70bba95c0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:14.922380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905c6e0-2fc9-429d-9daa-61852ff0b0b6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:14.979404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:14.992429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1ca5c-dbe9-4573-a4b1-6df348527284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:14.993333 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ca5c-dbe9-4573-a4b1-6df348527284 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:14.993619 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ca5c-dbe9-4573-a4b1-6df348527284 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:14.993898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ca5c-dbe9-4573-a4b1-6df348527284 None admin] PATH_INFO: `/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:14.999167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1ca5c-dbe9-4573-a4b1-6df348527284 None admin] RBAC: Authorizing `identity:get_user(user_id=014c5f64b9684a5185c3aa3e5fdb4aee)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:15.000653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1ca5c-dbe9-4573-a4b1-6df348527284 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:15.005716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 129/265] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:14 2022] GET /identity/v3/users/014c5f64b9684a5185c3aa3e5fdb4aee => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:15.007675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1ca5c-dbe9-4573-a4b1-6df348527284 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:15.150299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6916b8-8c52-443d-918b-82f70bba95c0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:15.195139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1ca5c-dbe9-4573-a4b1-6df348527284 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:15.221555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9f764-fc21-4fb3-a065-0018ab34a666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:15.222629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f764-fc21-4fb3-a065-0018ab34a666 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.223117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f764-fc21-4fb3-a065-0018ab34a666 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.223602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f764-fc21-4fb3-a065-0018ab34a666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.224657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9f764-fc21-4fb3-a065-0018ab34a666 None admin] RBAC: Adding query filter params (role.id=d3f29bc0265f45979298aa97cf42ee59, scope.project.id=f21952e768e3457caaf57d70eb4dc55f, user.id=014c5f64b9684a5185c3aa3e5fdb4aee) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:15.226058 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9f764-fc21-4fb3-a065-0018ab34a666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:15.227736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9f764-fc21-4fb3-a065-0018ab34a666 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:15.240957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 137/266] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:14 2022] GET /identity/v3/role_assignments?user.id=014c5f64b9684a5185c3aa3e5fdb4aee&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=d3f29bc0265f45979298aa97cf42ee59 => generated 608 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:15.242714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c302-0a56-45bf-98a5-b32ea86dfd61 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.243209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c302-0a56-45bf-98a5-b32ea86dfd61 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.243684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c302-0a56-45bf-98a5-b32ea86dfd61 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.245521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 138/267] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:15.246978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab50a39-588d-4364-a9e9-bde946778d7a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.247499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab50a39-588d-4364-a9e9-bde946778d7a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.247990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab50a39-588d-4364-a9e9-bde946778d7a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.248805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:15.249684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 139/268] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:15.256091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ac4a-f9d0-4a1a-9743-20affa98015d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.256707 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ac4a-f9d0-4a1a-9743-20affa98015d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.257782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ac4a-f9d0-4a1a-9743-20affa98015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.264075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0b2d-622d-4d70-a801-d2cb5fa15a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:15.265708 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0b2d-622d-4d70-a801-d2cb5fa15a76 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.267361 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0b2d-622d-4d70-a801-d2cb5fa15a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.267896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0b2d-622d-4d70-a801-d2cb5fa15a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.296899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8403ac4a-f9d0-4a1a-9743-20affa98015d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:15.299408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8403ac4a-f9d0-4a1a-9743-20affa98015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:15.421036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad0b2d-622d-4d70-a801-d2cb5fa15a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:15.423303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad0b2d-622d-4d70-a801-d2cb5fa15a76 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:15.441592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 140/269] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:15.443560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77911b-a804-4da2-80e8-439cfb27e437 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.444010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77911b-a804-4da2-80e8-439cfb27e437 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.444394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77911b-a804-4da2-80e8-439cfb27e437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.477816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-cb77911b-a804-4da2-80e8-439cfb27e437 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:15.479054 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cb77911b-a804-4da2-80e8-439cfb27e437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:15.505736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:15.562240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 130/270] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:15.563341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0b2d-622d-4d70-a801-d2cb5fa15a76 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:15.577243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 141/271] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:15.578463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77911b-a804-4da2-80e8-439cfb27e437 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:15.607371 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:15.704644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0b2d-622d-4d70-a801-d2cb5fa15a76 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:15.716851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77911b-a804-4da2-80e8-439cfb27e437 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:15.744130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c96a5-a017-4a85-9289-5567500081f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:15.744923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c96a5-a017-4a85-9289-5567500081f0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.745207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c96a5-a017-4a85-9289-5567500081f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.745491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c96a5-a017-4a85-9289-5567500081f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.746690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c96a5-a017-4a85-9289-5567500081f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:15.748761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c96a5-a017-4a85-9289-5567500081f0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:15.755084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 131/272] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:15.755084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c96a5-a017-4a85-9289-5567500081f0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:15.757359 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181db9e2-594f-45ff-96bd-6af827889a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:15.759606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181db9e2-594f-45ff-96bd-6af827889a98 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.760075 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181db9e2-594f-45ff-96bd-6af827889a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.760527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181db9e2-594f-45ff-96bd-6af827889a98 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.761894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181db9e2-594f-45ff-96bd-6af827889a98 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:15.764066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181db9e2-594f-45ff-96bd-6af827889a98 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:15.766454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 142/273] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:15 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:15.768539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a263-a601-4d02-b4c0-991443b6803e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.768990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a263-a601-4d02-b4c0-991443b6803e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.769430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a263-a601-4d02-b4c0-991443b6803e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.771842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 143/274] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:15.772721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898a263-a601-4d02-b4c0-991443b6803e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:15.805053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:15.859404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:15.862329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c96a5-a017-4a85-9289-5567500081f0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:15.888475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898a263-a601-4d02-b4c0-991443b6803e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:15.897506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44c671-05cb-41d6-9119-7b70713226a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:15.898306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44c671-05cb-41d6-9119-7b70713226a3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.898733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44c671-05cb-41d6-9119-7b70713226a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.899111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44c671-05cb-41d6-9119-7b70713226a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.910140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44c671-05cb-41d6-9119-7b70713226a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-6f44c671-05cb-41d6-9119-7b70713226a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:15.918422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:15.919827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:15.920622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 132/275] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:15.921272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44c671-05cb-41d6-9119-7b70713226a3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:15.930136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac9982-08d6-44aa-af15-e93f2c3e5341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:15.930843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9982-08d6-44aa-af15-e93f2c3e5341 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.931130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9982-08d6-44aa-af15-e93f2c3e5341 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.931397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9982-08d6-44aa-af15-e93f2c3e5341 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.932511 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac9982-08d6-44aa-af15-e93f2c3e5341 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:15.933951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac9982-08d6-44aa-af15-e93f2c3e5341 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:15.961057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 144/276] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:19:15 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:19:15.961057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1f3b6-7a35-40e5-88dc-9b2405fad24a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:15.961057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1f3b6-7a35-40e5-88dc-9b2405fad24a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:15.961057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1f3b6-7a35-40e5-88dc-9b2405fad24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:15.978132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-41b1f3b6-7a35-40e5-88dc-9b2405fad24a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:15.979496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-41b1f3b6-7a35-40e5-88dc-9b2405fad24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:16.049302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44c671-05cb-41d6-9119-7b70713226a3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:16.082533 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 145/277] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:16.083654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1f3b6-7a35-40e5-88dc-9b2405fad24a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:16.100473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ceff8-6d5b-4041-9ac6-29c891753405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:16.101156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ceff8-6d5b-4041-9ac6-29c891753405 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:16.101443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ceff8-6d5b-4041-9ac6-29c891753405 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:16.101723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ceff8-6d5b-4041-9ac6-29c891753405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:16.103972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ceff8-6d5b-4041-9ac6-29c891753405 None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=f21952e768e3457caaf57d70eb4dc55f, user.id=014c5f64b9684a5185c3aa3e5fdb4aee) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:16.104295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ceff8-6d5b-4041-9ac6-29c891753405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:16.107469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ceff8-6d5b-4041-9ac6-29c891753405 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:16.112826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:16.116262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 133/278] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:15 2022] GET /identity/v3/role_assignments?user.id=014c5f64b9684a5185c3aa3e5fdb4aee&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:16.117361 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ceff8-6d5b-4041-9ac6-29c891753405 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:16.151504 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:16.210266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1f3b6-7a35-40e5-88dc-9b2405fad24a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:16.246885 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ceff8-6d5b-4041-9ac6-29c891753405 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:16.248962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15a855-c60c-4915-b403-0357a84e36fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:16.249651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a855-c60c-4915-b403-0357a84e36fa None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:16.249935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a855-c60c-4915-b403-0357a84e36fa None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:16.250220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a855-c60c-4915-b403-0357a84e36fa None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:16.251035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15a855-c60c-4915-b403-0357a84e36fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:16.251345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15a855-c60c-4915-b403-0357a84e36fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:16.252759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15a855-c60c-4915-b403-0357a84e36fa None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:16.262319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 146/279] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:16.268230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15a855-c60c-4915-b403-0357a84e36fa None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:16.300932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f34e-db8f-4257-8bc1-9a19d117a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:16.301920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f34e-db8f-4257-8bc1-9a19d117a66a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:16.302205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f34e-db8f-4257-8bc1-9a19d117a66a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:16.302512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f34e-db8f-4257-8bc1-9a19d117a66a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:16.319298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1f34e-db8f-4257-8bc1-9a19d117a66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-57c1f34e-db8f-4257-8bc1-9a19d117a66a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:16.328722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:16.329638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:16.330469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:16.332174 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 134/280] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:16.339891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f34e-db8f-4257-8bc1-9a19d117a66a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:16.393059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:16.431086 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15a855-c60c-4915-b403-0357a84e36fa None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:16.476129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:16.479167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369c45a-3de8-4c63-83df-d882dc7741bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:16.480061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369c45a-3de8-4c63-83df-d882dc7741bc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:16.480345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369c45a-3de8-4c63-83df-d882dc7741bc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:16.480623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369c45a-3de8-4c63-83df-d882dc7741bc None admin] PATH_INFO: `/v3/users/5ec53ae953c443fe824d356cf927bd59` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:16.499899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369c45a-3de8-4c63-83df-d882dc7741bc None admin] RBAC: Authorizing `identity:get_user(user_id=5ec53ae953c443fe824d356cf927bd59)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:16.501283 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369c45a-3de8-4c63-83df-d882dc7741bc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:16.503044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f34e-db8f-4257-8bc1-9a19d117a66a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:16.503390 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 147/281] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:16 2022] GET /identity/v3/users/5ec53ae953c443fe824d356cf927bd59 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:16.508903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369c45a-3de8-4c63-83df-d882dc7741bc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:16.549872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6485d-1b18-4633-b8b3-1680ec3b9cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:16.550581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6485d-1b18-4633-b8b3-1680ec3b9cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:16.551133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6485d-1b18-4633-b8b3-1680ec3b9cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:16.551415 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6485d-1b18-4633-b8b3-1680ec3b9cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:16.552176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6485d-1b18-4633-b8b3-1680ec3b9cc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:16.552487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6485d-1b18-4633-b8b3-1680ec3b9cc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:16.554047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6485d-1b18-4633-b8b3-1680ec3b9cc8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:16.571536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 135/282] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:16.577572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6485d-1b18-4633-b8b3-1680ec3b9cc8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:16.642945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369c45a-3de8-4c63-83df-d882dc7741bc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:16.708762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ae08b-66f6-49c5-9f80-899eba84ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:16.709835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ae08b-66f6-49c5-9f80-899eba84ccfd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:16.711028 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ae08b-66f6-49c5-9f80-899eba84ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:16.711396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ae08b-66f6-49c5-9f80-899eba84ccfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:16.712326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ae08b-66f6-49c5-9f80-899eba84ccfd None admin] RBAC: Adding query filter params (role.id=6c516ab551054fc8bd24c92c7d9173ba, user.id=5ec53ae953c443fe824d356cf927bd59, scope.system=all) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:16.712718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ae08b-66f6-49c5-9f80-899eba84ccfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:16.714251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ae08b-66f6-49c5-9f80-899eba84ccfd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:16.716652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:16.726591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6485d-1b18-4633-b8b3-1680ec3b9cc8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:16.728890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 148/283] 10.222.0.44 () {56 vars in 1308 bytes} [Fri Jun 24 10:19:16 2022] GET /identity/v3/role_assignments?user.id=5ec53ae953c443fe824d356cf927bd59&scope.system=all&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:16.787913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d960b-d95f-4596-8dbe-a86ae8f2edae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:16.789161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d960b-d95f-4596-8dbe-a86ae8f2edae None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:16.789626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d960b-d95f-4596-8dbe-a86ae8f2edae None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:16.790102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d960b-d95f-4596-8dbe-a86ae8f2edae None admin] PATH_INFO: `/v3/users/cba607f3a40b4dc09dd0e6444dd76280` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:16.795310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d960b-d95f-4596-8dbe-a86ae8f2edae None admin] RBAC: Authorizing `identity:get_user(user_id=cba607f3a40b4dc09dd0e6444dd76280)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:16.797142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d960b-d95f-4596-8dbe-a86ae8f2edae None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:16.799183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 136/284] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:16 2022] GET /identity/v3/users/cba607f3a40b4dc09dd0e6444dd76280 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:16.805204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ae08b-66f6-49c5-9f80-899eba84ccfd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:16.901332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da6b26-1ac6-475b-b33b-f7d00188f063 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:16.902286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da6b26-1ac6-475b-b33b-f7d00188f063 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:16.902823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da6b26-1ac6-475b-b33b-f7d00188f063 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:16.904698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 137/285] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:16.910329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a4595-5cb5-42bc-b2e4-f15b9456b1dd None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:16.910936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a4595-5cb5-42bc-b2e4-f15b9456b1dd None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:16.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a4595-5cb5-42bc-b2e4-f15b9456b1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:16.929302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e62a4595-5cb5-42bc-b2e4-f15b9456b1dd None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:16.930944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e62a4595-5cb5-42bc-b2e4-f15b9456b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:16.943179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:17.007105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ae08b-66f6-49c5-9f80-899eba84ccfd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:17.059169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 138/286] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:17.067935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b412e7-4ec4-4ed5-b763-fbb1264ceb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:17.068863 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b412e7-4ec4-4ed5-b763-fbb1264ceb2c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:17.069350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b412e7-4ec4-4ed5-b763-fbb1264ceb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:17.069829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b412e7-4ec4-4ed5-b763-fbb1264ceb2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:17.101911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a4595-5cb5-42bc-b2e4-f15b9456b1dd None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:17.151585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b412e7-4ec4-4ed5-b763-fbb1264ceb2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:17.153078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b412e7-4ec4-4ed5-b763-fbb1264ceb2c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:17.211683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:17.257160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a4595-5cb5-42bc-b2e4-f15b9456b1dd None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:17.292829 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b7c1-f015-4898-8ad6-0e00ff43db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:17.293634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b7c1-f015-4898-8ad6-0e00ff43db9b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:17.293917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b7c1-f015-4898-8ad6-0e00ff43db9b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:17.294223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b7c1-f015-4898-8ad6-0e00ff43db9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:17.305517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9b7c1-f015-4898-8ad6-0e00ff43db9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:17.313193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 149/287] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-64c9b7c1-f015-4898-8ad6-0e00ff43db9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:17.313382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:17.314244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:17.315088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 139/288] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:17.318520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b412e7-4ec4-4ed5-b763-fbb1264ceb2c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:17.323293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b7c1-f015-4898-8ad6-0e00ff43db9b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:17.327771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:17.492299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b7c1-f015-4898-8ad6-0e00ff43db9b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:17.497886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:17.503248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b412e7-4ec4-4ed5-b763-fbb1264ceb2c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:17.547738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dcff5-c0bb-4053-95e3-81f03171639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:17.551678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dcff5-c0bb-4053-95e3-81f03171639d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:17.552266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dcff5-c0bb-4053-95e3-81f03171639d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:17.552864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dcff5-c0bb-4053-95e3-81f03171639d None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:17.556076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dcff5-c0bb-4053-95e3-81f03171639d None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:17.559135 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dcff5-c0bb-4053-95e3-81f03171639d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:17.574889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 150/289] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:17 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:17.583297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dcff5-c0bb-4053-95e3-81f03171639d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:17.595596 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ce008-9f10-42ed-99eb-c82c1e972621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:17.596278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce008-9f10-42ed-99eb-c82c1e972621 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:17.596562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce008-9f10-42ed-99eb-c82c1e972621 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:17.596838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce008-9f10-42ed-99eb-c82c1e972621 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:17.597602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ce008-9f10-42ed-99eb-c82c1e972621 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:17.597915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ce008-9f10-42ed-99eb-c82c1e972621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:17.599933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ce008-9f10-42ed-99eb-c82c1e972621 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:17.610296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 140/290] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:17.617857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ce008-9f10-42ed-99eb-c82c1e972621 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:17.702689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dcff5-c0bb-4053-95e3-81f03171639d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:17.742067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:17.776624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86972506-8884-443c-857e-a4a1459339b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:17.777283 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86972506-8884-443c-857e-a4a1459339b5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:17.777567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86972506-8884-443c-857e-a4a1459339b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:17.777845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86972506-8884-443c-857e-a4a1459339b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:17.778751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86972506-8884-443c-857e-a4a1459339b5 None admin] RBAC: Adding query filter params (role.id=6c516ab551054fc8bd24c92c7d9173ba, scope.project.id=f21952e768e3457caaf57d70eb4dc55f, user.id=cba607f3a40b4dc09dd0e6444dd76280) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:17.779047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86972506-8884-443c-857e-a4a1459339b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:17.781413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86972506-8884-443c-857e-a4a1459339b5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:17.788463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ce008-9f10-42ed-99eb-c82c1e972621 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:17.798128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 151/291] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:17 2022] GET /identity/v3/role_assignments?user.id=cba607f3a40b4dc09dd0e6444dd76280&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:17.847786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d573eae-4bf8-4db5-a1d2-e26c94082fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:17.848599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d573eae-4bf8-4db5-a1d2-e26c94082fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:17.848888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d573eae-4bf8-4db5-a1d2-e26c94082fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:17.849168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d573eae-4bf8-4db5-a1d2-e26c94082fe6 None admin] PATH_INFO: `/v3/users/64a7100c20634d64ba13149226f2e07f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:17.850543 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d573eae-4bf8-4db5-a1d2-e26c94082fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=64a7100c20634d64ba13149226f2e07f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:17.852036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d573eae-4bf8-4db5-a1d2-e26c94082fe6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:17.853976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 141/292] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:17 2022] GET /identity/v3/users/64a7100c20634d64ba13149226f2e07f => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:17.860066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86972506-8884-443c-857e-a4a1459339b5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:17.914884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:17.997041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86972506-8884-443c-857e-a4a1459339b5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:18.036285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58264f61-d1a1-4220-a069-0527f50f4461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:18.037154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58264f61-d1a1-4220-a069-0527f50f4461 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:18.037435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58264f61-d1a1-4220-a069-0527f50f4461 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:18.037705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58264f61-d1a1-4220-a069-0527f50f4461 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:18.038955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58264f61-d1a1-4220-a069-0527f50f4461 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:18.040377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58264f61-d1a1-4220-a069-0527f50f4461 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:18.042252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 152/293] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:17 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:18.049475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d573eae-4bf8-4db5-a1d2-e26c94082fe6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:18.160012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d573eae-4bf8-4db5-a1d2-e26c94082fe6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:18.202403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f71e1b-8ac3-4029-aba0-461f84b622ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:18.202627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f71e1b-8ac3-4029-aba0-461f84b622ac None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:18.203475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f71e1b-8ac3-4029-aba0-461f84b622ac None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:18.203475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f71e1b-8ac3-4029-aba0-461f84b622ac None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f/users/64a7100c20634d64ba13149226f2e07f/roles/1cfde5f2028c4ee8aa20c8665a6078e3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:18.205229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f71e1b-8ac3-4029-aba0-461f84b622ac None admin] RBAC: Authorizing `identity:create_grant(project_id=f21952e768e3457caaf57d70eb4dc55f, user_id=64a7100c20634d64ba13149226f2e07f, role_id=1cfde5f2028c4ee8aa20c8665a6078e3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:18.206730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f71e1b-8ac3-4029-aba0-461f84b622ac None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:18.209090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:18.228816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 142/294] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:19:18 2022] PUT /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f/users/64a7100c20634d64ba13149226f2e07f/roles/1cfde5f2028c4ee8aa20c8665a6078e3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:18.638215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f8303-0000-4417-9ff2-31eaa6815fb9 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:18.638693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f8303-0000-4417-9ff2-31eaa6815fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:18.639074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f8303-0000-4417-9ff2-31eaa6815fb9 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:18.640589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 153/295] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:19:18.645934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b27c29-28a7-40e9-8eec-77156ccc4089 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:18.646336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b27c29-28a7-40e9-8eec-77156ccc4089 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:18.646750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b27c29-28a7-40e9-8eec-77156ccc4089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:18.664177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-78b27c29-28a7-40e9-8eec-77156ccc4089 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:18.665448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-78b27c29-28a7-40e9-8eec-77156ccc4089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:18.739294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 143/296] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:18.752809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f59e-d7c9-46b7-8a1a-d4986c99dc7c None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:18.753101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f59e-d7c9-46b7-8a1a-d4986c99dc7c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:18.753381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f59e-d7c9-46b7-8a1a-d4986c99dc7c None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:18.754809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 154/297] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:18.759918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62c13c-59b9-48e4-bdb7-b498ab31f82e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:18.760217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62c13c-59b9-48e4-bdb7-b498ab31f82e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:18.760499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62c13c-59b9-48e4-bdb7-b498ab31f82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:18.762126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022f59e-d7c9-46b7-8a1a-d4986c99dc7c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:18.787952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9e62c13c-59b9-48e4-bdb7-b498ab31f82e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:18.789679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9e62c13c-59b9-48e4-bdb7-b498ab31f82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:18.882517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 144/298] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:18.890175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:18.895106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022f59e-d7c9-46b7-8a1a-d4986c99dc7c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:18.907072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62c13c-59b9-48e4-bdb7-b498ab31f82e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:18.956911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f455e-0837-4afb-9793-f3dd887eea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:18.958314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f455e-0837-4afb-9793-f3dd887eea11 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:18.959070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f455e-0837-4afb-9793-f3dd887eea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:18.959572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f455e-0837-4afb-9793-f3dd887eea11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:18.965628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:18.976959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f455e-0837-4afb-9793-f3dd887eea11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-450f455e-0837-4afb-9793-f3dd887eea11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:18.988003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:18.988931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:18.989712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:18.992153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 155/299] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:18.997380 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f455e-0837-4afb-9793-f3dd887eea11 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:19.020446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62c13c-59b9-48e4-bdb7-b498ab31f82e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:19.060806 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886919ee-3d62-42a7-a3f1-7ad4fbdbb7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:19.061683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886919ee-3d62-42a7-a3f1-7ad4fbdbb7bd None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.061867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886919ee-3d62-42a7-a3f1-7ad4fbdbb7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.062143 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886919ee-3d62-42a7-a3f1-7ad4fbdbb7bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.063418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886919ee-3d62-42a7-a3f1-7ad4fbdbb7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:19.065018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886919ee-3d62-42a7-a3f1-7ad4fbdbb7bd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:19.066984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 145/300] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:19.068137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a3fac-5d59-4b14-8db2-f37f057dcc73 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.068421 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a3fac-5d59-4b14-8db2-f37f057dcc73 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.068696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a3fac-5d59-4b14-8db2-f37f057dcc73 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.070292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 146/301] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:19.071976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a3fac-5d59-4b14-8db2-f37f057dcc73 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:19.109812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f455e-0837-4afb-9793-f3dd887eea11 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:19.144632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137eb19-26ab-42b0-b9f9-d948e169b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:19.145226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137eb19-26ab-42b0-b9f9-d948e169b400 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.145792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137eb19-26ab-42b0-b9f9-d948e169b400 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.145792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137eb19-26ab-42b0-b9f9-d948e169b400 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.146546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137eb19-26ab-42b0-b9f9-d948e169b400 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:19.146925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137eb19-26ab-42b0-b9f9-d948e169b400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:19.148371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137eb19-26ab-42b0-b9f9-d948e169b400 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:19.160592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 156/302] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:19.160592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678413-2739-483f-88af-5d283e083498 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.160592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678413-2739-483f-88af-5d283e083498 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.160592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20678413-2739-483f-88af-5d283e083498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.176158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-20678413-2739-483f-88af-5d283e083498 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:19.177343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-20678413-2739-483f-88af-5d283e083498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:19.188494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a3fac-5d59-4b14-8db2-f37f057dcc73 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:19.192677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:19.212692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:19.225807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c70885-a14f-4798-8875-0fb96b58debe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:19.226798 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c70885-a14f-4798-8875-0fb96b58debe None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.227088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c70885-a14f-4798-8875-0fb96b58debe None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.227369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c70885-a14f-4798-8875-0fb96b58debe None admin] PATH_INFO: `/v3/groups` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.228053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c70885-a14f-4798-8875-0fb96b58debe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:19.229590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c70885-a14f-4798-8875-0fb96b58debe None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:19.248070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 147/303] 10.222.0.44 () {60 vars in 1134 bytes} [Fri Jun 24 10:19:19 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:19:19.249214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c70885-a14f-4798-8875-0fb96b58debe None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:19.255006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 157/304] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:19.278728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20678413-2739-483f-88af-5d283e083498 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:19.381081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c70885-a14f-4798-8875-0fb96b58debe None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:19.419092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20678413-2739-483f-88af-5d283e083498 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:19.425983 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068f330-3e50-4853-9ab0-a3c1fbee08e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:19.427048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068f330-3e50-4853-9ab0-a3c1fbee08e9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.427379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068f330-3e50-4853-9ab0-a3c1fbee08e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.427662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068f330-3e50-4853-9ab0-a3c1fbee08e9 None admin] PATH_INFO: `/v3/users/e079294496c34a6c8887b9a59348dd4a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.447105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068f330-3e50-4853-9ab0-a3c1fbee08e9 None admin] RBAC: Authorizing `identity:get_user(user_id=e079294496c34a6c8887b9a59348dd4a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:19.449238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068f330-3e50-4853-9ab0-a3c1fbee08e9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:19.451379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 148/305] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:19 2022] GET /identity/v3/users/e079294496c34a6c8887b9a59348dd4a => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:19.457057 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068f330-3e50-4853-9ab0-a3c1fbee08e9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:19.464584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86958c-112e-443f-b5a8-f277bf4ee73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:19.465384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86958c-112e-443f-b5a8-f277bf4ee73d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.465666 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86958c-112e-443f-b5a8-f277bf4ee73d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.466371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86958c-112e-443f-b5a8-f277bf4ee73d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.478683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86958c-112e-443f-b5a8-f277bf4ee73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7d86958c-112e-443f-b5a8-f277bf4ee73d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:19.487434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:19.488303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:19.489089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 158/306] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:19.496868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86958c-112e-443f-b5a8-f277bf4ee73d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:19.512604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:19.520522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:19.585987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068f330-3e50-4853-9ab0-a3c1fbee08e9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:19.612098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86958c-112e-443f-b5a8-f277bf4ee73d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:19.623786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c30c2-2cdf-4d0a-8280-bc92ea876f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:19.624535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c30c2-2cdf-4d0a-8280-bc92ea876f6b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.624883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c30c2-2cdf-4d0a-8280-bc92ea876f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.625228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c30c2-2cdf-4d0a-8280-bc92ea876f6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.626132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c30c2-2cdf-4d0a-8280-bc92ea876f6b None admin] RBAC: Adding query filter params (role.id=1cfde5f2028c4ee8aa20c8665a6078e3, user.id=e079294496c34a6c8887b9a59348dd4a, scope.system=all) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:19.626620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c30c2-2cdf-4d0a-8280-bc92ea876f6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:19.628234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c30c2-2cdf-4d0a-8280-bc92ea876f6b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:19.638508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 149/307] 10.222.0.44 () {56 vars in 1308 bytes} [Fri Jun 24 10:19:19 2022] GET /identity/v3/role_assignments?user.id=e079294496c34a6c8887b9a59348dd4a&scope.system=all&role.id=1cfde5f2028c4ee8aa20c8665a6078e3 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:19.648592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4b5b8-8db0-43bb-9d4f-8e5a2b2d981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:19.649283 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4b5b8-8db0-43bb-9d4f-8e5a2b2d981f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.649569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4b5b8-8db0-43bb-9d4f-8e5a2b2d981f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.649851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4b5b8-8db0-43bb-9d4f-8e5a2b2d981f None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.650920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4b5b8-8db0-43bb-9d4f-8e5a2b2d981f None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:19.651462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4b5b8-8db0-43bb-9d4f-8e5a2b2d981f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:19.653123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4b5b8-8db0-43bb-9d4f-8e5a2b2d981f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:19.667633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 159/308] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:19.669712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c30c2-2cdf-4d0a-8280-bc92ea876f6b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:19.778795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c30c2-2cdf-4d0a-8280-bc92ea876f6b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:19.781647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:19.819866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676bb8-df36-417b-baa8-8526e9081c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:19.820754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676bb8-df36-417b-baa8-8526e9081c46 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.821039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676bb8-df36-417b-baa8-8526e9081c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.821316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676bb8-df36-417b-baa8-8526e9081c46 None admin] PATH_INFO: `/v3/users/5ec53ae953c443fe824d356cf927bd59` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.822546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676bb8-df36-417b-baa8-8526e9081c46 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec53ae953c443fe824d356cf927bd59)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:19.823992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676bb8-df36-417b-baa8-8526e9081c46 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:19.825937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 150/309] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:19 2022] GET /identity/v3/users/5ec53ae953c443fe824d356cf927bd59 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:19.831497 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4b5b8-8db0-43bb-9d4f-8e5a2b2d981f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:19.906899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:19.938179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4b5b8-8db0-43bb-9d4f-8e5a2b2d981f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:19.973630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e161e-6918-4244-a538-a1882890015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:19.974527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e161e-6918-4244-a538-a1882890015b None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:19.974814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e161e-6918-4244-a538-a1882890015b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:19.975095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e161e-6918-4244-a538-a1882890015b None admin] PATH_INFO: `/v3/system/users/5ec53ae953c443fe824d356cf927bd59/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:19.976588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e161e-6918-4244-a538-a1882890015b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5ec53ae953c443fe824d356cf927bd59, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:19.978029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e161e-6918-4244-a538-a1882890015b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:19.994536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 160/310] 10.222.0.44 () {58 vars in 1334 bytes} [Fri Jun 24 10:19:19 2022] PUT /identity/v3/system/users/5ec53ae953c443fe824d356cf927bd59/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:20.421194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d631-14a1-48ad-be77-5244691ff684 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:20.421733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d631-14a1-48ad-be77-5244691ff684 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:20.421733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d631-14a1-48ad-be77-5244691ff684 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:20.423274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 151/311] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:20.429205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564bb46-c36a-4738-9327-a4602439e1a4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:20.429719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564bb46-c36a-4738-9327-a4602439e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:20.429927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564bb46-c36a-4738-9327-a4602439e1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:20.448180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4564bb46-c36a-4738-9327-a4602439e1a4 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:20.449380 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4564bb46-c36a-4738-9327-a4602439e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:20.519963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 161/312] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:20.545762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d631-14a1-48ad-be77-5244691ff684 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:20.651741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d631-14a1-48ad-be77-5244691ff684 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:20.687203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3277-2390-4708-99fe-76fcb7151c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:20.687929 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3277-2390-4708-99fe-76fcb7151c97 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:20.688210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3277-2390-4708-99fe-76fcb7151c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:20.688488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3277-2390-4708-99fe-76fcb7151c97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:20.698717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f3277-2390-4708-99fe-76fcb7151c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-8c0f3277-2390-4708-99fe-76fcb7151c97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:20.706329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:20.707244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:20.708040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 152/313] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:20.713389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564bb46-c36a-4738-9327-a4602439e1a4 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:20.780987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:20.819056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564bb46-c36a-4738-9327-a4602439e1a4 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:20.855930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b603770-332e-4482-a679-70317d3224a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:20.857180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b603770-332e-4482-a679-70317d3224a2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:20.857464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b603770-332e-4482-a679-70317d3224a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:20.857742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b603770-332e-4482-a679-70317d3224a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:20.858525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b603770-332e-4482-a679-70317d3224a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:20.858833 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b603770-332e-4482-a679-70317d3224a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:20.860214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b603770-332e-4482-a679-70317d3224a2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:20.873446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 162/314] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:20.875022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3277-2390-4708-99fe-76fcb7151c97 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:20.907287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:20.981105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3277-2390-4708-99fe-76fcb7151c97 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:21.016585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066a03a-38d1-48b8-88f3-86c23bc1bea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:21.017795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066a03a-38d1-48b8-88f3-86c23bc1bea3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:21.018309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066a03a-38d1-48b8-88f3-86c23bc1bea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:21.018832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066a03a-38d1-48b8-88f3-86c23bc1bea3 None admin] PATH_INFO: `/v3/users/64a7100c20634d64ba13149226f2e07f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:21.020231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066a03a-38d1-48b8-88f3-86c23bc1bea3 None admin] RBAC: Authorizing `identity:get_user(user_id=64a7100c20634d64ba13149226f2e07f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:21.021889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066a03a-38d1-48b8-88f3-86c23bc1bea3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:21.024154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 153/315] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:20 2022] GET /identity/v3/users/64a7100c20634d64ba13149226f2e07f => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:21.034392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b603770-332e-4482-a679-70317d3224a2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:21.134009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b603770-332e-4482-a679-70317d3224a2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:21.161805 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:21.170222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecf80f-b9fb-48d6-bf69-7e1b3691715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:21.171035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecf80f-b9fb-48d6-bf69-7e1b3691715d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:21.171527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecf80f-b9fb-48d6-bf69-7e1b3691715d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:21.171806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecf80f-b9fb-48d6-bf69-7e1b3691715d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:21.243067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecf80f-b9fb-48d6-bf69-7e1b3691715d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:21.244449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecf80f-b9fb-48d6-bf69-7e1b3691715d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:21.359481 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 163/316] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:21.360845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066a03a-38d1-48b8-88f3-86c23bc1bea3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:21.384145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f683-c46d-4d23-aae6-8cc1359d48c7 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:21.384446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f683-c46d-4d23-aae6-8cc1359d48c7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:21.384720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f683-c46d-4d23-aae6-8cc1359d48c7 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:21.386367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 164/317] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:19:21.391696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae631af-f930-4d6c-b66e-66231964ec4d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:21.391987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae631af-f930-4d6c-b66e-66231964ec4d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:21.392263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae631af-f930-4d6c-b66e-66231964ec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:21.411771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1ae631af-f930-4d6c-b66e-66231964ec4d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:21.413692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1ae631af-f930-4d6c-b66e-66231964ec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:21.444469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:21.470962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:21.475278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066a03a-38d1-48b8-88f3-86c23bc1bea3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:21.514498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 165/318] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:21.517791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac1948-a6ef-4b2d-904d-e805624ea48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:21.518835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac1948-a6ef-4b2d-904d-e805624ea48e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:21.519256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac1948-a6ef-4b2d-904d-e805624ea48e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:21.519690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac1948-a6ef-4b2d-904d-e805624ea48e None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:21.521003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac1948-a6ef-4b2d-904d-e805624ea48e None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:21.522605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac1948-a6ef-4b2d-904d-e805624ea48e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:21.524469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 154/319] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:21 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:21.530272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae631af-f930-4d6c-b66e-66231964ec4d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:21.536295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac1948-a6ef-4b2d-904d-e805624ea48e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:21.653870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae631af-f930-4d6c-b66e-66231964ec4d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:21.655068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac1948-a6ef-4b2d-904d-e805624ea48e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:21.691165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e5b1-78e0-4042-b76a-59118fd2b478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:21.691872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e5b1-78e0-4042-b76a-59118fd2b478 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:21.692162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e5b1-78e0-4042-b76a-59118fd2b478 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:21.692439 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e5b1-78e0-4042-b76a-59118fd2b478 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:21.693616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03e5b1-78e0-4042-b76a-59118fd2b478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:21.695408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03e5b1-78e0-4042-b76a-59118fd2b478 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:21.701732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 166/320] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:21.702309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16901c84-ef80-4395-9340-e15ba88b7741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:21.703018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16901c84-ef80-4395-9340-e15ba88b7741 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:21.703364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16901c84-ef80-4395-9340-e15ba88b7741 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:21.703647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16901c84-ef80-4395-9340-e15ba88b7741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:21.704006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e5b1-78e0-4042-b76a-59118fd2b478 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:21.704539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16901c84-ef80-4395-9340-e15ba88b7741 None admin] RBAC: Adding query filter params (role.id=1cfde5f2028c4ee8aa20c8665a6078e3, scope.project.id=f21952e768e3457caaf57d70eb4dc55f, user.id=64a7100c20634d64ba13149226f2e07f) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:21.704860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16901c84-ef80-4395-9340-e15ba88b7741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:21.706309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16901c84-ef80-4395-9340-e15ba88b7741 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:21.718382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 155/321] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:21 2022] GET /identity/v3/role_assignments?user.id=64a7100c20634d64ba13149226f2e07f&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=1cfde5f2028c4ee8aa20c8665a6078e3 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:21.740611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:21.815986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094480-28bb-41a8-ad07-0f8829e14785 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:21.816316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094480-28bb-41a8-ad07-0f8829e14785 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:21.816545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094480-28bb-41a8-ad07-0f8829e14785 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:21.818149 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 156/322] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:21.825703 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd80107-04bf-406c-a14b-84a5ca8e3610 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:21.826049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd80107-04bf-406c-a14b-84a5ca8e3610 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:21.826280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd80107-04bf-406c-a14b-84a5ca8e3610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:21.829516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e5b1-78e0-4042-b76a-59118fd2b478 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:21.846998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1dd80107-04bf-406c-a14b-84a5ca8e3610 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:21.848410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1dd80107-04bf-406c-a14b-84a5ca8e3610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:21.873765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00759a23-1533-4379-b042-072bbeb42fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:21.874842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00759a23-1533-4379-b042-072bbeb42fef None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:21.875322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00759a23-1533-4379-b042-072bbeb42fef None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:21.875788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00759a23-1533-4379-b042-072bbeb42fef None admin] PATH_INFO: `/v3/groups` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:21.876729 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00759a23-1533-4379-b042-072bbeb42fef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:21.878412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00759a23-1533-4379-b042-072bbeb42fef None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:21.888824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:21.899713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 167/323] 10.222.0.44 () {60 vars in 1134 bytes} [Fri Jun 24 10:19:21 2022] POST /identity/v3/groups => generated 226 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:19:21.937923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 157/324] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:21.961226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00759a23-1533-4379-b042-072bbeb42fef None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:22.059280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:22.077777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00759a23-1533-4379-b042-072bbeb42fef None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:22.106841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c914-2856-469a-a38b-de087310e1d6 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:22.107170 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c914-2856-469a-a38b-de087310e1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:22.107456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c914-2856-469a-a38b-de087310e1d6 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:22.109088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 158/325] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:22.113088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95f5b0-0576-4e95-925c-02d3eb93b34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:22.113878 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95f5b0-0576-4e95-925c-02d3eb93b34f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:22.114139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde880-704d-4aff-a605-d7d7fbf52e8b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:22.114250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95f5b0-0576-4e95-925c-02d3eb93b34f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:22.114455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95f5b0-0576-4e95-925c-02d3eb93b34f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:22.114597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde880-704d-4aff-a605-d7d7fbf52e8b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:22.114761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde880-704d-4aff-a605-d7d7fbf52e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:22.126397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95f5b0-0576-4e95-925c-02d3eb93b34f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:22.131640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-01dde880-704d-4aff-a605-d7d7fbf52e8b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:22.132984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-01dde880-704d-4aff-a605-d7d7fbf52e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-db95f5b0-0576-4e95-925c-02d3eb93b34f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:22.133964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:22.134845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:22.135689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 168/326] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:22.141474 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95f5b0-0576-4e95-925c-02d3eb93b34f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:22.229323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 159/327] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:22.255328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dde880-704d-4aff-a605-d7d7fbf52e8b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:22.262008 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95f5b0-0576-4e95-925c-02d3eb93b34f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:22.311990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468feadb-6a4d-4d27-9ca1-382312894050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:22.312719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468feadb-6a4d-4d27-9ca1-382312894050 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:22.313260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468feadb-6a4d-4d27-9ca1-382312894050 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:22.313536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468feadb-6a4d-4d27-9ca1-382312894050 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:22.314894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468feadb-6a4d-4d27-9ca1-382312894050 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:22.315169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468feadb-6a4d-4d27-9ca1-382312894050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:22.316859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468feadb-6a4d-4d27-9ca1-382312894050 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:22.329283 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 169/328] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:22.335610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468feadb-6a4d-4d27-9ca1-382312894050 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:22.353214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:22.380656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:22.391268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dde880-704d-4aff-a605-d7d7fbf52e8b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:22.437168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c518f1e-734a-4a14-8050-2f0951104806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:22.438534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c518f1e-734a-4a14-8050-2f0951104806 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:22.438819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c518f1e-734a-4a14-8050-2f0951104806 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:22.439096 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c518f1e-734a-4a14-8050-2f0951104806 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:22.453695 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c518f1e-734a-4a14-8050-2f0951104806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-3c518f1e-734a-4a14-8050-2f0951104806 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:22.464331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:22.465253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:22.466630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 160/329] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:22.467311 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468feadb-6a4d-4d27-9ca1-382312894050 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:22.473749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c518f1e-734a-4a14-8050-2f0951104806 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:22.511396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67da217-79f4-4ac5-9003-a171d18b622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:22.513499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67da217-79f4-4ac5-9003-a171d18b622d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:22.513792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67da217-79f4-4ac5-9003-a171d18b622d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:22.514400 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67da217-79f4-4ac5-9003-a171d18b622d None admin] PATH_INFO: `/v3/users/e079294496c34a6c8887b9a59348dd4a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:22.515626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67da217-79f4-4ac5-9003-a171d18b622d None admin] RBAC: Authorizing `identity:get_user(user_id=e079294496c34a6c8887b9a59348dd4a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:22.517394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67da217-79f4-4ac5-9003-a171d18b622d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:22.520368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 170/330] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:22 2022] GET /identity/v3/users/e079294496c34a6c8887b9a59348dd4a => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:22.526390 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67da217-79f4-4ac5-9003-a171d18b622d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:22.609444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c518f1e-734a-4a14-8050-2f0951104806 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:22.629492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:22.652815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83ee82-fc55-46c7-a471-74ef71363e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:22.654316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83ee82-fc55-46c7-a471-74ef71363e2a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:22.654934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83ee82-fc55-46c7-a471-74ef71363e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:22.655349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83ee82-fc55-46c7-a471-74ef71363e2a None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:22.656438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83ee82-fc55-46c7-a471-74ef71363e2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:22.656963 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83ee82-fc55-46c7-a471-74ef71363e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:22.658772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83ee82-fc55-46c7-a471-74ef71363e2a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:22.659274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67da217-79f4-4ac5-9003-a171d18b622d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:22.668595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 161/331] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:22.675784 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83ee82-fc55-46c7-a471-74ef71363e2a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:22.697367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bcc02-6d99-4984-b22d-43b9b9d92008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:22.698728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bcc02-6d99-4984-b22d-43b9b9d92008 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:22.699010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bcc02-6d99-4984-b22d-43b9b9d92008 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:22.699288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bcc02-6d99-4984-b22d-43b9b9d92008 None admin] PATH_INFO: `/v3/system/users/e079294496c34a6c8887b9a59348dd4a/roles/1cfde5f2028c4ee8aa20c8665a6078e3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:22.702381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bcc02-6d99-4984-b22d-43b9b9d92008 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e079294496c34a6c8887b9a59348dd4a, role_id=1cfde5f2028c4ee8aa20c8665a6078e3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:22.705321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bcc02-6d99-4984-b22d-43b9b9d92008 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:22.709725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:22.721169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 171/332] 10.222.0.44 () {58 vars in 1334 bytes} [Fri Jun 24 10:19:22 2022] PUT /identity/v3/system/users/e079294496c34a6c8887b9a59348dd4a/roles/1cfde5f2028c4ee8aa20c8665a6078e3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:22.811415 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83ee82-fc55-46c7-a471-74ef71363e2a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:22.848873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebf24a-7d6b-4c60-9ec5-93a4b0c9b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:22.849761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebf24a-7d6b-4c60-9ec5-93a4b0c9b809 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:22.850043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebf24a-7d6b-4c60-9ec5-93a4b0c9b809 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:22.850317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebf24a-7d6b-4c60-9ec5-93a4b0c9b809 None admin] PATH_INFO: `/v3/users/5ec53ae953c443fe824d356cf927bd59` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:22.851648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebf24a-7d6b-4c60-9ec5-93a4b0c9b809 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec53ae953c443fe824d356cf927bd59)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:22.853173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebf24a-7d6b-4c60-9ec5-93a4b0c9b809 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:22.854964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 162/333] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:22 2022] GET /identity/v3/users/5ec53ae953c443fe824d356cf927bd59 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:22.861243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bcc02-6d99-4984-b22d-43b9b9d92008 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:23.005639 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bcc02-6d99-4984-b22d-43b9b9d92008 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:23.044949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d031bd3-c453-4c4b-8d92-6e5566666173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:23.045623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d031bd3-c453-4c4b-8d92-6e5566666173 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:23.045992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d031bd3-c453-4c4b-8d92-6e5566666173 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:23.046276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d031bd3-c453-4c4b-8d92-6e5566666173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:23.047245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d031bd3-c453-4c4b-8d92-6e5566666173 None admin] RBAC: Adding query filter params (role.id=6c516ab551054fc8bd24c92c7d9173ba, user.id=5ec53ae953c443fe824d356cf927bd59, scope.system=all) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:23.047569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d031bd3-c453-4c4b-8d92-6e5566666173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:23.049019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d031bd3-c453-4c4b-8d92-6e5566666173 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:23.057656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:23.068507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 172/334] 10.222.0.44 () {56 vars in 1308 bytes} [Fri Jun 24 10:19:22 2022] GET /identity/v3/role_assignments?user.id=5ec53ae953c443fe824d356cf927bd59&scope.system=all&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:24.615148 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe2c9c-dd27-4bfd-93ca-4074542a4746 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:24.616131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe2c9c-dd27-4bfd-93ca-4074542a4746 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:24.616609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe2c9c-dd27-4bfd-93ca-4074542a4746 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:24.618579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 163/335] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:24.624888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5739e6-754c-457e-86c4-967813b87f45 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:24.625732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5739e6-754c-457e-86c4-967813b87f45 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:24.626207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5739e6-754c-457e-86c4-967813b87f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:24.647985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5c5739e6-754c-457e-86c4-967813b87f45 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:24.649516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5c5739e6-754c-457e-86c4-967813b87f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:24.739733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 173/336] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:24.779621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe2c9c-dd27-4bfd-93ca-4074542a4746 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:24.885332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:24.905930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe2c9c-dd27-4bfd-93ca-4074542a4746 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:24.948752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bc360-8302-47e0-8e8e-10099fc65814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:24.949568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc360-8302-47e0-8e8e-10099fc65814 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:24.949918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc360-8302-47e0-8e8e-10099fc65814 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:24.950246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc360-8302-47e0-8e8e-10099fc65814 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:24.963579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bc360-8302-47e0-8e8e-10099fc65814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-263bc360-8302-47e0-8e8e-10099fc65814 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:24.971936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:24.972804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:24.973598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 164/337] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:24.979186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5739e6-754c-457e-86c4-967813b87f45 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:25.096332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5739e6-754c-457e-86c4-967813b87f45 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:25.129028 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:25.131251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96270245-d0d6-47e2-8397-ca5a21a4ad37 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:25.131545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96270245-d0d6-47e2-8397-ca5a21a4ad37 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:25.131824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96270245-d0d6-47e2-8397-ca5a21a4ad37 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:25.133209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 165/338] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:25.145485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb996-f9f0-454e-9a8e-f4beb6db5aca None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:25.145766 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb996-f9f0-454e-9a8e-f4beb6db5aca None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:25.145858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de282ec2-11c3-4a92-8377-10d88ff1dbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:25.146030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb996-f9f0-454e-9a8e-f4beb6db5aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:25.146505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de282ec2-11c3-4a92-8377-10d88ff1dbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:25.146796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de282ec2-11c3-4a92-8377-10d88ff1dbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:25.147072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de282ec2-11c3-4a92-8377-10d88ff1dbf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:25.147840 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de282ec2-11c3-4a92-8377-10d88ff1dbf2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:25.148147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de282ec2-11c3-4a92-8377-10d88ff1dbf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:25.149648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de282ec2-11c3-4a92-8377-10d88ff1dbf2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:25.160134 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 174/339] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:25.165596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de282ec2-11c3-4a92-8377-10d88ff1dbf2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:25.183408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9b5fb996-f9f0-454e-9a8e-f4beb6db5aca None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:25.185179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9b5fb996-f9f0-454e-9a8e-f4beb6db5aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:25.290831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de282ec2-11c3-4a92-8377-10d88ff1dbf2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:25.337375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a36120-ca54-4327-accf-176ee0caff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:25.338025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a36120-ca54-4327-accf-176ee0caff00 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:25.338309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a36120-ca54-4327-accf-176ee0caff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:25.338617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a36120-ca54-4327-accf-176ee0caff00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:25.352308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 166/340] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:25.385779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fb996-f9f0-454e-9a8e-f4beb6db5aca None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:25.422811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:25.435768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a36120-ca54-4327-accf-176ee0caff00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:25.437247 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a36120-ca54-4327-accf-176ee0caff00 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:25.546342 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:25.597874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fb996-f9f0-454e-9a8e-f4beb6db5aca None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:25.607629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 175/341] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:25.613258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a36120-ca54-4327-accf-176ee0caff00 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:25.651147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2252c-b868-4931-a53b-55f08119e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:25.652719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2252c-b868-4931-a53b-55f08119e18a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:25.653232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2252c-b868-4931-a53b-55f08119e18a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:25.653720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2252c-b868-4931-a53b-55f08119e18a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:25.683422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2252c-b868-4931-a53b-55f08119e18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c5e2252c-b868-4931-a53b-55f08119e18a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:25.692257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:25.693126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:25.693902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:25.696624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 167/342] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:25.702503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2252c-b868-4931-a53b-55f08119e18a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:25.775310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:25.794181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a36120-ca54-4327-accf-176ee0caff00 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:25.863525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e21472-41db-49aa-a500-00fe362a0df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:25.865511 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e21472-41db-49aa-a500-00fe362a0df5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:25.866164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e21472-41db-49aa-a500-00fe362a0df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:25.867892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e21472-41db-49aa-a500-00fe362a0df5 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:25.869516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e21472-41db-49aa-a500-00fe362a0df5 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:25.872112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e21472-41db-49aa-a500-00fe362a0df5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:25.875863 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 176/343] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:25 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:25.878789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f1fa-1f68-442a-b7d2-bd1e47a7ddae None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:25.880322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f1fa-1f68-442a-b7d2-bd1e47a7ddae None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:25.881026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f1fa-1f68-442a-b7d2-bd1e47a7ddae None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:25.883800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 177/344] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:25.885496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003f1fa-1f68-442a-b7d2-bd1e47a7ddae None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:25.901606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2252c-b868-4931-a53b-55f08119e18a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:25.940455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:25.947059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae654ef-f937-40ef-83d0-2dd5d9c4fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:25.948018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae654ef-f937-40ef-83d0-2dd5d9c4fc21 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:25.948495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae654ef-f937-40ef-83d0-2dd5d9c4fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:25.949114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae654ef-f937-40ef-83d0-2dd5d9c4fc21 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:25.951615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae654ef-f937-40ef-83d0-2dd5d9c4fc21 None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:25.951615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae654ef-f937-40ef-83d0-2dd5d9c4fc21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:25.952688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae654ef-f937-40ef-83d0-2dd5d9c4fc21 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:25.963006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 168/345] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:25.964325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284d16-67a4-4fba-856e-69c38660e6a1 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:25.964712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284d16-67a4-4fba-856e-69c38660e6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:25.965104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284d16-67a4-4fba-856e-69c38660e6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:25.986162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-20284d16-67a4-4fba-856e-69c38660e6a1 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:25.988011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-20284d16-67a4-4fba-856e-69c38660e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:26.014675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003f1fa-1f68-442a-b7d2-bd1e47a7ddae None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:26.061334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da873245-aaf5-4625-8d3f-e5a41e87fc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:26.062558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da873245-aaf5-4625-8d3f-e5a41e87fc5a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.063012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da873245-aaf5-4625-8d3f-e5a41e87fc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.063429 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da873245-aaf5-4625-8d3f-e5a41e87fc5a None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.069787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da873245-aaf5-4625-8d3f-e5a41e87fc5a None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:26.071458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da873245-aaf5-4625-8d3f-e5a41e87fc5a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:26.073586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 178/346] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:25 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:26.075585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b7eb3-acb7-4dc6-87f8-fe5ea920afee None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.076026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b7eb3-acb7-4dc6-87f8-fe5ea920afee None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.077310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b7eb3-acb7-4dc6-87f8-fe5ea920afee None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.077436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 169/347] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:26.077724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20284d16-67a4-4fba-856e-69c38660e6a1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:26.079133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 179/348] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:26.081398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8c1d-7d85-4f44-8dae-e3e8decd65db None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.081905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8c1d-7d85-4f44-8dae-e3e8decd65db None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.082423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8c1d-7d85-4f44-8dae-e3e8decd65db None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.083955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 180/349] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:26.085212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc15f0b-f9ff-4970-85fe-25fd32844f71 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.085781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc15f0b-f9ff-4970-85fe-25fd32844f71 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.086265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc15f0b-f9ff-4970-85fe-25fd32844f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.103387 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0bc15f0b-f9ff-4970-85fe-25fd32844f71 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:26.105038 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0bc15f0b-f9ff-4970-85fe-25fd32844f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:26.133631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:26.185179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 181/350] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:26.186472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc15f0b-f9ff-4970-85fe-25fd32844f71 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:26.201621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20284d16-67a4-4fba-856e-69c38660e6a1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:26.234855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:26.249217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17377e51-deb2-4bda-93b2-4e4f873504b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:26.249882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17377e51-deb2-4bda-93b2-4e4f873504b4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.250171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17377e51-deb2-4bda-93b2-4e4f873504b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.250484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17377e51-deb2-4bda-93b2-4e4f873504b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.323199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc15f0b-f9ff-4970-85fe-25fd32844f71 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:26.331185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17377e51-deb2-4bda-93b2-4e4f873504b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:26.332675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17377e51-deb2-4bda-93b2-4e4f873504b4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:26.376390 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b98a4c-2085-4f7d-b4ab-253d5ac40b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:26.377099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98a4c-2085-4f7d-b4ab-253d5ac40b52 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.377386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98a4c-2085-4f7d-b4ab-253d5ac40b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.377656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98a4c-2085-4f7d-b4ab-253d5ac40b52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.379230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b98a4c-2085-4f7d-b4ab-253d5ac40b52 None admin] RBAC: Adding query filter params (group.id=0cbe5108da3b496f96e80d990ed303ef, role.id=d3f29bc0265f45979298aa97cf42ee59, scope.project.id=0de6538741964c2b8766be7436e4800e) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:26.379230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b98a4c-2085-4f7d-b4ab-253d5ac40b52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:26.380326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b98a4c-2085-4f7d-b4ab-253d5ac40b52 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:26.386192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 182/351] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Jun 24 10:19:26 2022] GET /identity/v3/role_assignments?group.id=0cbe5108da3b496f96e80d990ed303ef&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=d3f29bc0265f45979298aa97cf42ee59 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:26.387625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2e2e7-8c30-4656-9e5f-0dcdc4ad7082 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.387829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2e2e7-8c30-4656-9e5f-0dcdc4ad7082 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.388107 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2e2e7-8c30-4656-9e5f-0dcdc4ad7082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.408084 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d1e2e2e7-8c30-4656-9e5f-0dcdc4ad7082 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:26.409318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d1e2e2e7-8c30-4656-9e5f-0dcdc4ad7082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:26.425590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:26.482468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 170/352] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:26.483466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17377e51-deb2-4bda-93b2-4e4f873504b4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:26.510813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 183/353] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:26.511693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2e2e7-8c30-4656-9e5f-0dcdc4ad7082 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:26.531716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:26.651135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17377e51-deb2-4bda-93b2-4e4f873504b4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:26.659941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2e2e7-8c30-4656-9e5f-0dcdc4ad7082 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:26.703396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edbb9f-17c9-40c0-bf83-17442db35781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:26.704210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edbb9f-17c9-40c0-bf83-17442db35781 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.704494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edbb9f-17c9-40c0-bf83-17442db35781 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.704769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edbb9f-17c9-40c0-bf83-17442db35781 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.713818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e47dbe-2765-4c73-991e-cfdd3325c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:26.714661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e47dbe-2765-4c73-991e-cfdd3325c769 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.714946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e47dbe-2765-4c73-991e-cfdd3325c769 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.715742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e47dbe-2765-4c73-991e-cfdd3325c769 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.721663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edbb9f-17c9-40c0-bf83-17442db35781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:26.727973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e47dbe-2765-4c73-991e-cfdd3325c769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-85edbb9f-17c9-40c0-bf83-17442db35781 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:26.731896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:26.732846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 10:19:26.733663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:26.736333 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 171/354] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-35e47dbe-2765-4c73-991e-cfdd3325c769 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:26.736621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:26.737478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:26.738330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 184/355] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:26.739803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e47dbe-2765-4c73-991e-cfdd3325c769 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:26.740694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edbb9f-17c9-40c0-bf83-17442db35781 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:26.749921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:26.852938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e47dbe-2765-4c73-991e-cfdd3325c769 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:26.854765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:26.872920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edbb9f-17c9-40c0-bf83-17442db35781 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:26.890080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce564b9-b401-4837-b160-ffdc16a822fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:26.891037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce564b9-b401-4837-b160-ffdc16a822fe None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.891296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce564b9-b401-4837-b160-ffdc16a822fe None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.891662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce564b9-b401-4837-b160-ffdc16a822fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.905001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce564b9-b401-4837-b160-ffdc16a822fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:26.912842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12df35-1c2f-4a3f-b410-2ff6759c0bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-6ce564b9-b401-4837-b160-ffdc16a822fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:26.913904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:26.914825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:26.915634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 185/356] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:26.916302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce564b9-b401-4837-b160-ffdc16a822fe None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:26.917221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12df35-1c2f-4a3f-b410-2ff6759c0bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:26.917727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12df35-1c2f-4a3f-b410-2ff6759c0bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:26.918288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12df35-1c2f-4a3f-b410-2ff6759c0bb1 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:26.920309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12df35-1c2f-4a3f-b410-2ff6759c0bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:26.922075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12df35-1c2f-4a3f-b410-2ff6759c0bb1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:26.928616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 172/357] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:26 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:26.929676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12df35-1c2f-4a3f-b410-2ff6759c0bb1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:26.996308 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:27.041425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce564b9-b401-4837-b160-ffdc16a822fe None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:27.055583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12df35-1c2f-4a3f-b410-2ff6759c0bb1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:27.085229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ade22-0ec0-46eb-96a0-42b19d869fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:27.086536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ade22-0ec0-46eb-96a0-42b19d869fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:27.086853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ade22-0ec0-46eb-96a0-42b19d869fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:27.087138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ade22-0ec0-46eb-96a0-42b19d869fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:27.087907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ade22-0ec0-46eb-96a0-42b19d869fb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:27.088222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ade22-0ec0-46eb-96a0-42b19d869fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:27.090759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ade22-0ec0-46eb-96a0-42b19d869fb2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:27.101070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 186/358] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:27.102475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271571e-2d61-4822-9911-5f46f45f865f None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:27.103324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e3d12-4d40-4d69-892a-6b45a7fd7b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:27.103672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271571e-2d61-4822-9911-5f46f45f865f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:27.103954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271571e-2d61-4822-9911-5f46f45f865f None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:27.104651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3d12-4d40-4d69-892a-6b45a7fd7b01 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:27.105146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3d12-4d40-4d69-892a-6b45a7fd7b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:27.105248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 187/359] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:27.105705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3d12-4d40-4d69-892a-6b45a7fd7b01 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:27.106455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271571e-2d61-4822-9911-5f46f45f865f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:27.107511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3d12-4d40-4d69-892a-6b45a7fd7b01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:27.108083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3d12-4d40-4d69-892a-6b45a7fd7b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:27.110037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3d12-4d40-4d69-892a-6b45a7fd7b01 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:27.122220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 173/360] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:27.123586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e3d12-4d40-4d69-892a-6b45a7fd7b01 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:27.150883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:27.239368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271571e-2d61-4822-9911-5f46f45f865f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:27.257092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e3d12-4d40-4d69-892a-6b45a7fd7b01 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:27.281298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:27.295507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb88a3-95eb-47da-9c86-a5edee63ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:27.296477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb88a3-95eb-47da-9c86-a5edee63ea18 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:27.296992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb88a3-95eb-47da-9c86-a5edee63ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:27.297277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb88a3-95eb-47da-9c86-a5edee63ea18 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:27.298101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb88a3-95eb-47da-9c86-a5edee63ea18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:27.298383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb88a3-95eb-47da-9c86-a5edee63ea18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:27.299835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb88a3-95eb-47da-9c86-a5edee63ea18 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:27.301035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e3ce7-77b8-4d47-ace7-48e53e2ce7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:27.301930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3ce7-77b8-4d47-ace7-48e53e2ce7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:27.302186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3ce7-77b8-4d47-ace7-48e53e2ce7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:27.302523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3ce7-77b8-4d47-ace7-48e53e2ce7e8 None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:27.303776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e3ce7-77b8-4d47-ace7-48e53e2ce7e8 None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:27.305195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e3ce7-77b8-4d47-ace7-48e53e2ce7e8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:27.307178 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 174/361] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:27 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:27.308365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50239012-8abd-4e02-a9d6-8d25bdf7f827 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:27.308653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50239012-8abd-4e02-a9d6-8d25bdf7f827 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:27.308979 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50239012-8abd-4e02-a9d6-8d25bdf7f827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:27.314868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 188/362] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:27.315599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb88a3-95eb-47da-9c86-a5edee63ea18 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:27.328707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-50239012-8abd-4e02-a9d6-8d25bdf7f827 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:27.329914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-50239012-8abd-4e02-a9d6-8d25bdf7f827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:27.412044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 175/363] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:27.413476 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50239012-8abd-4e02-a9d6-8d25bdf7f827 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:27.430189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:27.439711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb88a3-95eb-47da-9c86-a5edee63ea18 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:27.490117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2eb01-3808-4f70-a125-ef89bad4f053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:27.491196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2eb01-3808-4f70-a125-ef89bad4f053 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:27.491484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2eb01-3808-4f70-a125-ef89bad4f053 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:27.492082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2eb01-3808-4f70-a125-ef89bad4f053 None admin] PATH_INFO: `/v3/users/e079294496c34a6c8887b9a59348dd4a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:27.493575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2eb01-3808-4f70-a125-ef89bad4f053 None admin] RBAC: Authorizing `identity:get_user(user_id=e079294496c34a6c8887b9a59348dd4a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:27.495175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2eb01-3808-4f70-a125-ef89bad4f053 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:27.496955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 189/364] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:19:27 2022] GET /identity/v3/users/e079294496c34a6c8887b9a59348dd4a => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:27.497528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2eb01-3808-4f70-a125-ef89bad4f053 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:27.545336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50239012-8abd-4e02-a9d6-8d25bdf7f827 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:27.567526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:27.600883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ce1b5-5fc4-48f0-b1f9-39904b75e822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:27.600883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ce1b5-5fc4-48f0-b1f9-39904b75e822 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:27.601169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ce1b5-5fc4-48f0-b1f9-39904b75e822 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:27.601241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ce1b5-5fc4-48f0-b1f9-39904b75e822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:27.626716 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2eb01-3808-4f70-a125-ef89bad4f053 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:27.679213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518059f-fab8-4d8b-9228-59e594440e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:27.680340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518059f-fab8-4d8b-9228-59e594440e68 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:27.680864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518059f-fab8-4d8b-9228-59e594440e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:27.681329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518059f-fab8-4d8b-9228-59e594440e68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:27.682722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518059f-fab8-4d8b-9228-59e594440e68 None admin] RBAC: Adding query filter params (group.id=0cbe5108da3b496f96e80d990ed303ef, role.id=6c516ab551054fc8bd24c92c7d9173ba, scope.project.id=0de6538741964c2b8766be7436e4800e) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:27.682722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518059f-fab8-4d8b-9228-59e594440e68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:27.684723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518059f-fab8-4d8b-9228-59e594440e68 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:27.693151 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 190/365] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Jun 24 10:19:27 2022] GET /identity/v3/role_assignments?group.id=0cbe5108da3b496f96e80d990ed303ef&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:27.693759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518059f-fab8-4d8b-9228-59e594440e68 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:27.706869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ce1b5-5fc4-48f0-b1f9-39904b75e822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:27.709038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ce1b5-5fc4-48f0-b1f9-39904b75e822 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:27.727030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:27.816697 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518059f-fab8-4d8b-9228-59e594440e68 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:27.844914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:27.859950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 176/366] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:27.860903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ce1b5-5fc4-48f0-b1f9-39904b75e822 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:27.861083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489bf85-902b-4a77-aab5-50de07c90bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:27.861844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489bf85-902b-4a77-aab5-50de07c90bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:27.862134 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489bf85-902b-4a77-aab5-50de07c90bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:27.862442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489bf85-902b-4a77-aab5-50de07c90bc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:27.956915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489bf85-902b-4a77-aab5-50de07c90bc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:27.959118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489bf85-902b-4a77-aab5-50de07c90bc2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:28.001964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ce1b5-5fc4-48f0-b1f9-39904b75e822 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:28.016659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:28.052129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a7760-b99d-4738-86f3-ecf86c940f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:28.053110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a7760-b99d-4738-86f3-ecf86c940f64 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:28.053364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a7760-b99d-4738-86f3-ecf86c940f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:28.053647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a7760-b99d-4738-86f3-ecf86c940f64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:28.068857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a7760-b99d-4738-86f3-ecf86c940f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e57a7760-b99d-4738-86f3-ecf86c940f64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:28.077935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:28.079053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:28.080140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 177/367] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:28.080818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a7760-b99d-4738-86f3-ecf86c940f64 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:28.104643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 191/368] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:28.105900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489bf85-902b-4a77-aab5-50de07c90bc2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:28.139464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:28.208060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a7760-b99d-4738-86f3-ecf86c940f64 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:28.237657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489bf85-902b-4a77-aab5-50de07c90bc2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:28.250003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfaa28-5c14-46cc-8b58-6ba433f8b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:28.250981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfaa28-5c14-46cc-8b58-6ba433f8b038 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:28.251471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfaa28-5c14-46cc-8b58-6ba433f8b038 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:28.251948 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfaa28-5c14-46cc-8b58-6ba433f8b038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:28.252978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfaa28-5c14-46cc-8b58-6ba433f8b038 None admin] RBAC: Adding query filter params (role.id=1cfde5f2028c4ee8aa20c8665a6078e3, user.id=e079294496c34a6c8887b9a59348dd4a, scope.system=all) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:28.253490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfaa28-5c14-46cc-8b58-6ba433f8b038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:28.256114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfaa28-5c14-46cc-8b58-6ba433f8b038 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:28.270001 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 178/369] 10.222.0.44 () {56 vars in 1308 bytes} [Fri Jun 24 10:19:28 2022] GET /identity/v3/role_assignments?user.id=e079294496c34a6c8887b9a59348dd4a&scope.system=all&role.id=1cfde5f2028c4ee8aa20c8665a6078e3 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:28.271140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfaa28-5c14-46cc-8b58-6ba433f8b038 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:28.286025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb29d8-a29a-4827-89ee-b1fae392ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:28.286924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb29d8-a29a-4827-89ee-b1fae392ea90 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:28.287213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb29d8-a29a-4827-89ee-b1fae392ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:28.287805 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb29d8-a29a-4827-89ee-b1fae392ea90 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:28.291616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb29d8-a29a-4827-89ee-b1fae392ea90 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:28.293293 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb29d8-a29a-4827-89ee-b1fae392ea90 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:28.296357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 192/370] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:28 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:28.297387 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb29d8-a29a-4827-89ee-b1fae392ea90 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:28.332487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:28.495694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb29d8-a29a-4827-89ee-b1fae392ea90 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:28.512286 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:28.513224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfaa28-5c14-46cc-8b58-6ba433f8b038 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:28.535025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e6774-ddf4-4eb7-a04c-e5209e655495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:28.536395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6774-ddf4-4eb7-a04c-e5209e655495 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:28.536878 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6774-ddf4-4eb7-a04c-e5209e655495 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:28.537342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6774-ddf4-4eb7-a04c-e5209e655495 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:28.538975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e6774-ddf4-4eb7-a04c-e5209e655495 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:28.540609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e6774-ddf4-4eb7-a04c-e5209e655495 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:28.542886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 193/371] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:28 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:28.544430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e6774-ddf4-4eb7-a04c-e5209e655495 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:28.599104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08b464-6939-448f-955e-17d70de9cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:28.599706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08b464-6939-448f-955e-17d70de9cc31 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:28.599992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08b464-6939-448f-955e-17d70de9cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:28.600271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08b464-6939-448f-955e-17d70de9cc31 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:28.601027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08b464-6939-448f-955e-17d70de9cc31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:28.601394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08b464-6939-448f-955e-17d70de9cc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:28.602759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08b464-6939-448f-955e-17d70de9cc31 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:28.614140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 179/372] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:28.614865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08b464-6939-448f-955e-17d70de9cc31 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:28.723860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e6774-ddf4-4eb7-a04c-e5209e655495 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:28.745931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:28.755791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08b464-6939-448f-955e-17d70de9cc31 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:28.774181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6167421-bc95-499d-9185-89bb40c5f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:28.775656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6167421-bc95-499d-9185-89bb40c5f882 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:28.775656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6167421-bc95-499d-9185-89bb40c5f882 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:28.775656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6167421-bc95-499d-9185-89bb40c5f882 None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:28.776836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6167421-bc95-499d-9185-89bb40c5f882 None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:28.778902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6167421-bc95-499d-9185-89bb40c5f882 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:28.780566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 194/373] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:28 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:28.782035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6167421-bc95-499d-9185-89bb40c5f882 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:28.797112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bb7ef-992c-4d4d-8ab4-90f602cb4eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:28.797972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb7ef-992c-4d4d-8ab4-90f602cb4eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:28.798255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb7ef-992c-4d4d-8ab4-90f602cb4eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:28.798564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb7ef-992c-4d4d-8ab4-90f602cb4eb7 None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:28.799734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bb7ef-992c-4d4d-8ab4-90f602cb4eb7 None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:28.801447 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bb7ef-992c-4d4d-8ab4-90f602cb4eb7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:28.803411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 180/374] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:28 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:28.804613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18743c-24ec-45fb-bfe5-29d5194b5813 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:28.804903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18743c-24ec-45fb-bfe5-29d5194b5813 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:28.805183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18743c-24ec-45fb-bfe5-29d5194b5813 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:28.806560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 181/375] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:28.807129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18743c-24ec-45fb-bfe5-29d5194b5813 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:28.814713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:28.912501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6167421-bc95-499d-9185-89bb40c5f882 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:28.949448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18743c-24ec-45fb-bfe5-29d5194b5813 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:28.958147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6eb2a-fc63-47ad-a1d5-3090e8c669de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:28.958857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6eb2a-fc63-47ad-a1d5-3090e8c669de None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:28.959408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6eb2a-fc63-47ad-a1d5-3090e8c669de None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:28.959584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6eb2a-fc63-47ad-a1d5-3090e8c669de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:29.003105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd2931-ea03-41e5-98eb-a2c7e167c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:29.003775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd2931-ea03-41e5-98eb-a2c7e167c1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:29.004066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd2931-ea03-41e5-98eb-a2c7e167c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:29.004348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd2931-ea03-41e5-98eb-a2c7e167c1d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:29.005198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd2931-ea03-41e5-98eb-a2c7e167c1d2 None admin] RBAC: Adding query filter params (group.id=0cbe5108da3b496f96e80d990ed303ef, role.id=d3f29bc0265f45979298aa97cf42ee59, scope.project.id=f21952e768e3457caaf57d70eb4dc55f) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:29.005515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd2931-ea03-41e5-98eb-a2c7e167c1d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:29.007018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd2931-ea03-41e5-98eb-a2c7e167c1d2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:29.015876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 182/376] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Jun 24 10:19:28 2022] GET /identity/v3/role_assignments?group.id=0cbe5108da3b496f96e80d990ed303ef&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=d3f29bc0265f45979298aa97cf42ee59 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:29.017272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd2931-ea03-41e5-98eb-a2c7e167c1d2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:29.046956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:29.061659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6eb2a-fc63-47ad-a1d5-3090e8c669de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:29.063214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6eb2a-fc63-47ad-a1d5-3090e8c669de None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:29.103436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:29.136957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd2931-ea03-41e5-98eb-a2c7e167c1d2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:29.179665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a986858-a216-47b3-abba-78bfd443f20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:29.180315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a986858-a216-47b3-abba-78bfd443f20d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:29.180603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a986858-a216-47b3-abba-78bfd443f20d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:29.180934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a986858-a216-47b3-abba-78bfd443f20d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:29.181795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a986858-a216-47b3-abba-78bfd443f20d None admin] RBAC: Adding query filter params (group.id=0cbe5108da3b496f96e80d990ed303ef, role.id=6c516ab551054fc8bd24c92c7d9173ba, scope.project.id=f21952e768e3457caaf57d70eb4dc55f) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:29.182114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a986858-a216-47b3-abba-78bfd443f20d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:29.184385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a986858-a216-47b3-abba-78bfd443f20d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:29.194733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 183/377] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Jun 24 10:19:29 2022] GET /identity/v3/role_assignments?group.id=0cbe5108da3b496f96e80d990ed303ef&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:29.196785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb6fba-c66f-48d7-a858-2171c84a223c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:29.197344 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb6fba-c66f-48d7-a858-2171c84a223c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:29.197630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb6fba-c66f-48d7-a858-2171c84a223c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:29.204053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 195/378] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:29.210175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6eb2a-fc63-47ad-a1d5-3090e8c669de None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:29.219288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-54fb6fba-c66f-48d7-a858-2171c84a223c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:29.220535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-54fb6fba-c66f-48d7-a858-2171c84a223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:29.312877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 184/379] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:29.351273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb6fba-c66f-48d7-a858-2171c84a223c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:29.352111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6eb2a-fc63-47ad-a1d5-3090e8c669de None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:29.394381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:29.403318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:29.420733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81955cb4-840a-481f-8a2a-508e1b9efeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:29.421640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81955cb4-840a-481f-8a2a-508e1b9efeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:29.421930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81955cb4-840a-481f-8a2a-508e1b9efeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:29.422213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81955cb4-840a-481f-8a2a-508e1b9efeb9 None admin] PATH_INFO: `/v3/projects/f43b9dcf7aae4875bca38a800d08c70f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:29.426894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81955cb4-840a-481f-8a2a-508e1b9efeb9 None admin] RBAC: Authorizing `identity:get_project(project_id=f43b9dcf7aae4875bca38a800d08c70f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:29.428506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81955cb4-840a-481f-8a2a-508e1b9efeb9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:29.437500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 196/380] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:29 2022] GET /identity/v3/projects/f43b9dcf7aae4875bca38a800d08c70f => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:29.441650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81955cb4-840a-481f-8a2a-508e1b9efeb9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:29.515612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb6fba-c66f-48d7-a858-2171c84a223c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:29.557971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc5722-5c83-4629-900c-828a10a2345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:29.558844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc5722-5c83-4629-900c-828a10a2345e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:29.559130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc5722-5c83-4629-900c-828a10a2345e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:29.559406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc5722-5c83-4629-900c-828a10a2345e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:29.564076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81955cb4-840a-481f-8a2a-508e1b9efeb9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:29.581815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc5722-5c83-4629-900c-828a10a2345e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-cefc5722-5c83-4629-900c-828a10a2345e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:29.591430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:29.592366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:29.593181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:29.597670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 185/381] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:29.598586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc5722-5c83-4629-900c-828a10a2345e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:29.614219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147be56f-aa97-4768-b887-6b18bf24a9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:29.615466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147be56f-aa97-4768-b887-6b18bf24a9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:29.615974 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147be56f-aa97-4768-b887-6b18bf24a9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:29.616450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147be56f-aa97-4768-b887-6b18bf24a9e1 None admin] PATH_INFO: `/v3/groups/a28d61d3970c4ad1940b03bd5b634843` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:29.623007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147be56f-aa97-4768-b887-6b18bf24a9e1 None admin] RBAC: Authorizing `identity:get_group(group_id=a28d61d3970c4ad1940b03bd5b634843)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:29.624717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147be56f-aa97-4768-b887-6b18bf24a9e1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:29.630532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 197/382] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:29 2022] GET /identity/v3/groups/a28d61d3970c4ad1940b03bd5b634843 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:29.634723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147be56f-aa97-4768-b887-6b18bf24a9e1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:29.683619 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:29.701071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:29.707971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc5722-5c83-4629-900c-828a10a2345e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:29.748434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147be56f-aa97-4768-b887-6b18bf24a9e1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:29.748787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d401eb7-e769-4707-b952-bee02d30f87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:29.749466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d401eb7-e769-4707-b952-bee02d30f87b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:29.749753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d401eb7-e769-4707-b952-bee02d30f87b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:29.750029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d401eb7-e769-4707-b952-bee02d30f87b None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:29.752100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d401eb7-e769-4707-b952-bee02d30f87b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:29.752100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d401eb7-e769-4707-b952-bee02d30f87b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:29.752492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d401eb7-e769-4707-b952-bee02d30f87b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:29.762009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 186/383] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:29.767909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d401eb7-e769-4707-b952-bee02d30f87b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:29.790156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9d52b-9b00-4128-af2e-7f84a1dd98ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:29.791260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9d52b-9b00-4128-af2e-7f84a1dd98ee None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:29.791775 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9d52b-9b00-4128-af2e-7f84a1dd98ee None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:29.792254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9d52b-9b00-4128-af2e-7f84a1dd98ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:29.793385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9d52b-9b00-4128-af2e-7f84a1dd98ee None admin] RBAC: Adding query filter params (group.id=a28d61d3970c4ad1940b03bd5b634843, role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=f43b9dcf7aae4875bca38a800d08c70f) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:29.793905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9d52b-9b00-4128-af2e-7f84a1dd98ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:29.795590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9d52b-9b00-4128-af2e-7f84a1dd98ee None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:29.804827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 198/384] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Jun 24 10:19:29 2022] GET /identity/v3/role_assignments?group.id=a28d61d3970c4ad1940b03bd5b634843&scope.project.id=f43b9dcf7aae4875bca38a800d08c70f&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:29.882104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d401eb7-e769-4707-b952-bee02d30f87b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:29.927894 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127713-262e-40a7-a955-ebd2d15f4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:29.928768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127713-262e-40a7-a955-ebd2d15f4ace None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:29.929052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127713-262e-40a7-a955-ebd2d15f4ace None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:29.929330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127713-262e-40a7-a955-ebd2d15f4ace None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:29.931035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127713-262e-40a7-a955-ebd2d15f4ace None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:29.932516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127713-262e-40a7-a955-ebd2d15f4ace None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:29.935126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 187/385] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:29 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:29.940784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9d52b-9b00-4128-af2e-7f84a1dd98ee None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:30.082244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9d52b-9b00-4128-af2e-7f84a1dd98ee None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:30.107099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:30.118155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d945c6-225c-4cd9-836b-2bdd57ccb1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:30.119303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d945c6-225c-4cd9-836b-2bdd57ccb1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:30.119820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d945c6-225c-4cd9-836b-2bdd57ccb1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:30.120301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d945c6-225c-4cd9-836b-2bdd57ccb1e3 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:30.121785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d945c6-225c-4cd9-836b-2bdd57ccb1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:30.123585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d945c6-225c-4cd9-836b-2bdd57ccb1e3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:30.125884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 199/386] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:29 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:30.131399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127713-262e-40a7-a955-ebd2d15f4ace None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:30.152585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:30.281765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127713-262e-40a7-a955-ebd2d15f4ace None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:30.323326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee71bb-0626-4d0c-9939-6b6434600a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:30.324254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee71bb-0626-4d0c-9939-6b6434600a25 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:30.325075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee71bb-0626-4d0c-9939-6b6434600a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:30.325352 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee71bb-0626-4d0c-9939-6b6434600a25 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e/groups/0cbe5108da3b496f96e80d990ed303ef/roles/d3f29bc0265f45979298aa97cf42ee59` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:30.331665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee71bb-0626-4d0c-9939-6b6434600a25 None admin] RBAC: Authorizing `identity:create_grant(project_id=0de6538741964c2b8766be7436e4800e, group_id=0cbe5108da3b496f96e80d990ed303ef, role_id=d3f29bc0265f45979298aa97cf42ee59)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:30.333200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee71bb-0626-4d0c-9939-6b6434600a25 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:30.361269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 188/387] 10.222.0.44 () {58 vars in 1442 bytes} [Fri Jun 24 10:19:30 2022] PUT /identity/v3/projects/0de6538741964c2b8766be7436e4800e/groups/0cbe5108da3b496f96e80d990ed303ef/roles/d3f29bc0265f45979298aa97cf42ee59 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:30.418923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9353-66d6-4ebd-bcf9-8fd30cce95a6 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:30.419285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9353-66d6-4ebd-bcf9-8fd30cce95a6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:30.419480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc9353-66d6-4ebd-bcf9-8fd30cce95a6 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:30.421328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 200/388] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:30.427845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7634-6570-4e6e-8558-9ffbe3551e7a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:30.428145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7634-6570-4e6e-8558-9ffbe3551e7a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:30.428399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7634-6570-4e6e-8558-9ffbe3551e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:30.446813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1dbf7634-6570-4e6e-8558-9ffbe3551e7a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:30.448032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1dbf7634-6570-4e6e-8558-9ffbe3551e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:30.515050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:30.520668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 189/389] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:30.543493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc9353-66d6-4ebd-bcf9-8fd30cce95a6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:30.664005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc9353-66d6-4ebd-bcf9-8fd30cce95a6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:30.701442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bd161-7e54-49d7-a157-2bcd3b2d1cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:30.702272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bd161-7e54-49d7-a157-2bcd3b2d1cfb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:30.702584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bd161-7e54-49d7-a157-2bcd3b2d1cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:30.702871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bd161-7e54-49d7-a157-2bcd3b2d1cfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:30.716919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bd161-7e54-49d7-a157-2bcd3b2d1cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-fe8bd161-7e54-49d7-a157-2bcd3b2d1cfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:30.725413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:30.726379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:30.727261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 201/390] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:30.734172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7634-6570-4e6e-8558-9ffbe3551e7a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:30.892245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7634-6570-4e6e-8558-9ffbe3551e7a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:30.932717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed517ba-f099-4303-a639-b0c12f91caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:30.933312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed517ba-f099-4303-a639-b0c12f91caaf None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:30.933599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed517ba-f099-4303-a639-b0c12f91caaf None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:30.934467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed517ba-f099-4303-a639-b0c12f91caaf None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:30.935223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed517ba-f099-4303-a639-b0c12f91caaf None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:30.935529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed517ba-f099-4303-a639-b0c12f91caaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:30.936909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed517ba-f099-4303-a639-b0c12f91caaf None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:30.949760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 190/391] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:30.955362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bd161-7e54-49d7-a157-2bcd3b2d1cfb None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:31.042789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:31.097907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bd161-7e54-49d7-a157-2bcd3b2d1cfb None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:31.132761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4534f9-f17e-4243-9c59-446554f2d915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:31.133627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4534f9-f17e-4243-9c59-446554f2d915 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:31.133917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4534f9-f17e-4243-9c59-446554f2d915 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:31.134200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4534f9-f17e-4243-9c59-446554f2d915 None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:31.135407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4534f9-f17e-4243-9c59-446554f2d915 None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:31.136944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4534f9-f17e-4243-9c59-446554f2d915 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:31.139980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 202/392] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:30 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:31.144781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed517ba-f099-4303-a639-b0c12f91caaf None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:31.222160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:31.265389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed517ba-f099-4303-a639-b0c12f91caaf None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:31.305988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009aeaa2-f424-4434-8d5d-064696e94580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:31.306889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aeaa2-f424-4434-8d5d-064696e94580 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:31.307177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aeaa2-f424-4434-8d5d-064696e94580 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:31.307454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aeaa2-f424-4434-8d5d-064696e94580 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:31.309200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aeaa2-f424-4434-8d5d-064696e94580 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:31.310670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aeaa2-f424-4434-8d5d-064696e94580 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:31.316857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 191/393] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:31 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:31.318769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4534f9-f17e-4243-9c59-446554f2d915 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:31.423634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4534f9-f17e-4243-9c59-446554f2d915 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:31.442816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:31.460469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aed322-5cf0-423f-9685-5149aead19e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:31.461609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed322-5cf0-423f-9685-5149aead19e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:31.461901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed322-5cf0-423f-9685-5149aead19e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:31.462183 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed322-5cf0-423f-9685-5149aead19e6 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e/groups/0cbe5108da3b496f96e80d990ed303ef/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:31.464208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aed322-5cf0-423f-9685-5149aead19e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0de6538741964c2b8766be7436e4800e, group_id=0cbe5108da3b496f96e80d990ed303ef, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:31.465694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aed322-5cf0-423f-9685-5149aead19e6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:31.488434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 203/394] 10.222.0.44 () {58 vars in 1442 bytes} [Fri Jun 24 10:19:31 2022] PUT /identity/v3/projects/0de6538741964c2b8766be7436e4800e/groups/0cbe5108da3b496f96e80d990ed303ef/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:31.709478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a08af-b4bc-4346-8dc1-255aa23a0c2d None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:31.709839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a08af-b4bc-4346-8dc1-255aa23a0c2d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:31.710036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a08af-b4bc-4346-8dc1-255aa23a0c2d None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:31.711743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 192/395] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:31.716928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ddf99-049a-4541-a7d6-413f63751dae None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:31.717222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ddf99-049a-4541-a7d6-413f63751dae None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:31.717502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ddf99-049a-4541-a7d6-413f63751dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:31.739421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4a3ddf99-049a-4541-a7d6-413f63751dae None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:31.740541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4a3ddf99-049a-4541-a7d6-413f63751dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:31.814606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa78a96-0ef2-4bfe-92da-86efb02126a5 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:31.814947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa78a96-0ef2-4bfe-92da-86efb02126a5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:31.815165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa78a96-0ef2-4bfe-92da-86efb02126a5 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:31.817043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 193/396] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:31.823921 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b85d-c4c5-471f-a105-3d4c4c35410f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:31.824248 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b85d-c4c5-471f-a105-3d4c4c35410f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:31.824816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b85d-c4c5-471f-a105-3d4c4c35410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:31.831228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 204/397] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:31.843493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ca91b85d-c4c5-471f-a105-3d4c4c35410f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:31.844694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ca91b85d-c4c5-471f-a105-3d4c4c35410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:31.878806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ddf99-049a-4541-a7d6-413f63751dae None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:31.960361 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 194/398] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:32.009487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b85d-c4c5-471f-a105-3d4c4c35410f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:32.026208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ddf99-049a-4541-a7d6-413f63751dae None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:32.036718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:32.064212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a165c2-0120-4267-af20-832e57f3dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:32.065018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a165c2-0120-4267-af20-832e57f3dc26 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:32.065303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a165c2-0120-4267-af20-832e57f3dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:32.065578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a165c2-0120-4267-af20-832e57f3dc26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:32.076395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a165c2-0120-4267-af20-832e57f3dc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-e5a165c2-0120-4267-af20-832e57f3dc26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:32.084335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:32.085333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:32.086166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:32.090731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 205/399] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:32.096587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a165c2-0120-4267-af20-832e57f3dc26 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:32.119498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:32.210209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b85d-c4c5-471f-a105-3d4c4c35410f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:32.265643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a165c2-0120-4267-af20-832e57f3dc26 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:32.272328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3018d93-8e27-4b55-8aa9-a4e63395ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:32.273146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3018d93-8e27-4b55-8aa9-a4e63395ed7a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:32.273428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3018d93-8e27-4b55-8aa9-a4e63395ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:32.273704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3018d93-8e27-4b55-8aa9-a4e63395ed7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:32.295277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3018d93-8e27-4b55-8aa9-a4e63395ed7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a3018d93-8e27-4b55-8aa9-a4e63395ed7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:32.306112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:32.307034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:32.307833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:32.309013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 195/400] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:32.314832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3018d93-8e27-4b55-8aa9-a4e63395ed7a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:32.335924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8bc6f-77da-49cf-bf11-a003cfc19dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:32.336598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8bc6f-77da-49cf-bf11-a003cfc19dbb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:32.336882 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8bc6f-77da-49cf-bf11-a003cfc19dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:32.337159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8bc6f-77da-49cf-bf11-a003cfc19dbb None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:32.339948 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8bc6f-77da-49cf-bf11-a003cfc19dbb None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:32.340770 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8bc6f-77da-49cf-bf11-a003cfc19dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:32.343730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8bc6f-77da-49cf-bf11-a003cfc19dbb None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:32.364179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 206/401] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:32.369723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8bc6f-77da-49cf-bf11-a003cfc19dbb None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:32.406013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:32.464578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3018d93-8e27-4b55-8aa9-a4e63395ed7a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:32.483283 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:32.494551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8bc6f-77da-49cf-bf11-a003cfc19dbb None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:32.502123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768d24f-9d95-42fd-abf9-c176a96cf38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:32.502899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d24f-9d95-42fd-abf9-c176a96cf38e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:32.503250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d24f-9d95-42fd-abf9-c176a96cf38e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:32.503667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d24f-9d95-42fd-abf9-c176a96cf38e None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:32.504509 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768d24f-9d95-42fd-abf9-c176a96cf38e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:32.504881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768d24f-9d95-42fd-abf9-c176a96cf38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:32.506343 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768d24f-9d95-42fd-abf9-c176a96cf38e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:32.516113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 196/402] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:32.517540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb537c6-89ea-4a8b-9acb-78d0dcddb1c8 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:32.517831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb537c6-89ea-4a8b-9acb-78d0dcddb1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:32.518108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb537c6-89ea-4a8b-9acb-78d0dcddb1c8 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:32.519506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 197/403] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:32.524228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb537c6-89ea-4a8b-9acb-78d0dcddb1c8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:32.535012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14873-d823-40cd-b753-dfffe1edea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:32.536136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14873-d823-40cd-b753-dfffe1edea00 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:32.536438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14873-d823-40cd-b753-dfffe1edea00 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:32.536842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14873-d823-40cd-b753-dfffe1edea00 None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:32.538188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a14873-d823-40cd-b753-dfffe1edea00 None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:32.539922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a14873-d823-40cd-b753-dfffe1edea00 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:32.542483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 207/404] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:32 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:32.543890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6179-f04a-49df-b485-94832a03ae3b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:32.544279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6179-f04a-49df-b485-94832a03ae3b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:32.544731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6179-f04a-49df-b485-94832a03ae3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:32.563666 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-34de6179-f04a-49df-b485-94832a03ae3b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:32.564953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-34de6179-f04a-49df-b485-94832a03ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:32.643551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb537c6-89ea-4a8b-9acb-78d0dcddb1c8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:32.645468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 208/405] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:32.646615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de6179-f04a-49df-b485-94832a03ae3b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:32.684439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9755ef-a4e5-404c-8907-0f3102808d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:32.685392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9755ef-a4e5-404c-8907-0f3102808d35 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:32.685757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9755ef-a4e5-404c-8907-0f3102808d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:32.686095 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9755ef-a4e5-404c-8907-0f3102808d35 None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:32.688149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:32.688377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9755ef-a4e5-404c-8907-0f3102808d35 None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:32.692842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9755ef-a4e5-404c-8907-0f3102808d35 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:32.696330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 198/406] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:32 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:32.697321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9755ef-a4e5-404c-8907-0f3102808d35 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:32.758976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:32.786209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de6179-f04a-49df-b485-94832a03ae3b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:32.827877 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a09d7-0562-453e-a9fe-4dcb3f94e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:32.828777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a09d7-0562-453e-a9fe-4dcb3f94e575 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:32.829070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a09d7-0562-453e-a9fe-4dcb3f94e575 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:32.829350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a09d7-0562-453e-a9fe-4dcb3f94e575 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:32.830603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a09d7-0562-453e-a9fe-4dcb3f94e575 None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:32.830743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9755ef-a4e5-404c-8907-0f3102808d35 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:32.832049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a09d7-0562-453e-a9fe-4dcb3f94e575 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:32.841359 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 209/407] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:32 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:32.843101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a09d7-0562-453e-a9fe-4dcb3f94e575 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:32.872121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9caca0-2911-4bf3-ae76-ec605cb37e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:32.872933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9caca0-2911-4bf3-ae76-ec605cb37e56 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:32.873218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9caca0-2911-4bf3-ae76-ec605cb37e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:32.873494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9caca0-2911-4bf3-ae76-ec605cb37e56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:32.886240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9caca0-2911-4bf3-ae76-ec605cb37e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-8e9caca0-2911-4bf3-ae76-ec605cb37e56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:32.895011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:32.895913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:32.896713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 199/408] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:32.898033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9caca0-2911-4bf3-ae76-ec605cb37e56 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:32.978578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:32.987258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a09d7-0562-453e-a9fe-4dcb3f94e575 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:33.021506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9caca0-2911-4bf3-ae76-ec605cb37e56 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:33.032425 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:33.038930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb569a-25c8-4fc4-b5db-270d1828a32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:33.040694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb569a-25c8-4fc4-b5db-270d1828a32b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.041429 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb569a-25c8-4fc4-b5db-270d1828a32b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.041915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb569a-25c8-4fc4-b5db-270d1828a32b None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.043720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb569a-25c8-4fc4-b5db-270d1828a32b None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:33.045428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb569a-25c8-4fc4-b5db-270d1828a32b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:33.048635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 210/409] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:32 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:33.050154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb569a-25c8-4fc4-b5db-270d1828a32b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:33.061771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3a86b-25c2-4909-b5b8-7becdb7cb75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:33.062681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3a86b-25c2-4909-b5b8-7becdb7cb75d None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.062964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3a86b-25c2-4909-b5b8-7becdb7cb75d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.063243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3a86b-25c2-4909-b5b8-7becdb7cb75d None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f/groups/0cbe5108da3b496f96e80d990ed303ef/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.065344 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3a86b-25c2-4909-b5b8-7becdb7cb75d None admin] RBAC: Authorizing `identity:create_grant(project_id=f21952e768e3457caaf57d70eb4dc55f, group_id=0cbe5108da3b496f96e80d990ed303ef, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:33.067083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3a86b-25c2-4909-b5b8-7becdb7cb75d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:33.086858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 200/410] 10.222.0.44 () {58 vars in 1442 bytes} [Fri Jun 24 10:19:32 2022] PUT /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f/groups/0cbe5108da3b496f96e80d990ed303ef/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:33.087803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3a86b-25c2-4909-b5b8-7becdb7cb75d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:33.180057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb569a-25c8-4fc4-b5db-270d1828a32b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:33.221509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354a98f-1416-4590-b4af-47d45aee6c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:33.222702 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354a98f-1416-4590-b4af-47d45aee6c64 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.223207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354a98f-1416-4590-b4af-47d45aee6c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.223685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354a98f-1416-4590-b4af-47d45aee6c64 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.224760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354a98f-1416-4590-b4af-47d45aee6c64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:33.225272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354a98f-1416-4590-b4af-47d45aee6c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:33.227007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354a98f-1416-4590-b4af-47d45aee6c64 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:33.237174 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 211/411] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:33.239060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff07b07-e198-4a8b-83a0-9f949b91d3fa None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.239548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff07b07-e198-4a8b-83a0-9f949b91d3fa None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.240033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff07b07-e198-4a8b-83a0-9f949b91d3fa None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.241839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 212/412] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:33.242801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff07b07-e198-4a8b-83a0-9f949b91d3fa None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:33.252244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3a86b-25c2-4909-b5b8-7becdb7cb75d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:33.279605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:33.306770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be50a3c-b4f5-4083-adf1-5ed3f1fafa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:33.307882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50a3c-b4f5-4083-adf1-5ed3f1fafa36 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.308174 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50a3c-b4f5-4083-adf1-5ed3f1fafa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.308490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50a3c-b4f5-4083-adf1-5ed3f1fafa36 None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f/groups/0cbe5108da3b496f96e80d990ed303ef/roles/d3f29bc0265f45979298aa97cf42ee59` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.311499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be50a3c-b4f5-4083-adf1-5ed3f1fafa36 None admin] RBAC: Authorizing `identity:create_grant(project_id=f21952e768e3457caaf57d70eb4dc55f, group_id=0cbe5108da3b496f96e80d990ed303ef, role_id=d3f29bc0265f45979298aa97cf42ee59)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:33.312989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be50a3c-b4f5-4083-adf1-5ed3f1fafa36 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:33.332772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 201/413] 10.222.0.44 () {58 vars in 1442 bytes} [Fri Jun 24 10:19:33 2022] PUT /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f/groups/0cbe5108da3b496f96e80d990ed303ef/roles/d3f29bc0265f45979298aa97cf42ee59 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:33.334679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d931d7c-00be-4b99-8072-54026e2866f0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.335273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d931d7c-00be-4b99-8072-54026e2866f0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.335863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d931d7c-00be-4b99-8072-54026e2866f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.355358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9d931d7c-00be-4b99-8072-54026e2866f0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:33.356913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9d931d7c-00be-4b99-8072-54026e2866f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:33.378687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff07b07-e198-4a8b-83a0-9f949b91d3fa None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:33.390909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:33.424409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47640c0-ae45-42a1-aa87-334fcc807cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:33.425875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47640c0-ae45-42a1-aa87-334fcc807cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.427711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47640c0-ae45-42a1-aa87-334fcc807cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.428208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47640c0-ae45-42a1-aa87-334fcc807cb9 None admin] PATH_INFO: `/v3/groups/a28d61d3970c4ad1940b03bd5b634843` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.431083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47640c0-ae45-42a1-aa87-334fcc807cb9 None admin] RBAC: Authorizing `identity:get_group(group_id=a28d61d3970c4ad1940b03bd5b634843)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:33.433035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47640c0-ae45-42a1-aa87-334fcc807cb9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:33.436578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 213/414] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:33 2022] GET /identity/v3/groups/a28d61d3970c4ad1940b03bd5b634843 => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:33.442239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47640c0-ae45-42a1-aa87-334fcc807cb9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:33.488644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 202/415] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:33.533735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d931d7c-00be-4b99-8072-54026e2866f0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:33.592644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:33.601385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47640c0-ae45-42a1-aa87-334fcc807cb9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:33.648732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bf7e8-24ea-4762-9b2a-d53e2b09edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:33.649989 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bf7e8-24ea-4762-9b2a-d53e2b09edcc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.650279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bf7e8-24ea-4762-9b2a-d53e2b09edcc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.650594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bf7e8-24ea-4762-9b2a-d53e2b09edcc None admin] PATH_INFO: `/v3/projects/f43b9dcf7aae4875bca38a800d08c70f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.652198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bf7e8-24ea-4762-9b2a-d53e2b09edcc None admin] RBAC: Authorizing `identity:get_project(project_id=f43b9dcf7aae4875bca38a800d08c70f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:33.654234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bf7e8-24ea-4762-9b2a-d53e2b09edcc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:33.656582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 214/416] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:33 2022] GET /identity/v3/projects/f43b9dcf7aae4875bca38a800d08c70f => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:33.663276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bf7e8-24ea-4762-9b2a-d53e2b09edcc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:33.681058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d931d7c-00be-4b99-8072-54026e2866f0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:33.721249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93481071-7820-4ab5-bd49-e31bd808cf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:33.722511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481071-7820-4ab5-bd49-e31bd808cf76 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.723105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481071-7820-4ab5-bd49-e31bd808cf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.723539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481071-7820-4ab5-bd49-e31bd808cf76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.736933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93481071-7820-4ab5-bd49-e31bd808cf76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-93481071-7820-4ab5-bd49-e31bd808cf76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:33.747725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:33.748833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:33.749811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:33.752594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 203/417] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:33.760698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93481071-7820-4ab5-bd49-e31bd808cf76 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:33.785957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:33.869381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bf7e8-24ea-4762-9b2a-d53e2b09edcc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:33.906523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93481071-7820-4ab5-bd49-e31bd808cf76 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:33.908054 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc2d93-9ff9-4f54-bd99-3116754b60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:33.908943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc2d93-9ff9-4f54-bd99-3116754b60c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.909228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc2d93-9ff9-4f54-bd99-3116754b60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.909510 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc2d93-9ff9-4f54-bd99-3116754b60c0 None admin] PATH_INFO: `/v3/projects/f43b9dcf7aae4875bca38a800d08c70f/groups/a28d61d3970c4ad1940b03bd5b634843/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.911527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc2d93-9ff9-4f54-bd99-3116754b60c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f43b9dcf7aae4875bca38a800d08c70f, group_id=a28d61d3970c4ad1940b03bd5b634843, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:33.913000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc2d93-9ff9-4f54-bd99-3116754b60c0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:33.929480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 215/418] 10.222.0.44 () {58 vars in 1442 bytes} [Fri Jun 24 10:19:33 2022] PUT /identity/v3/projects/f43b9dcf7aae4875bca38a800d08c70f/groups/a28d61d3970c4ad1940b03bd5b634843/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:33.963605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6a14e-5b18-4377-b602-8ecd09ae185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:33.964294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a14e-5b18-4377-b602-8ecd09ae185c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.964629 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a14e-5b18-4377-b602-8ecd09ae185c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.964954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a14e-5b18-4377-b602-8ecd09ae185c None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.965790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a14e-5b18-4377-b602-8ecd09ae185c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:33.966103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a14e-5b18-4377-b602-8ecd09ae185c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:33.967637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a14e-5b18-4377-b602-8ecd09ae185c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:33.978183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 204/419] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:33.984122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc2d93-9ff9-4f54-bd99-3116754b60c0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:33.991884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1ad66-001a-47b2-bf1e-822d2e70fc10 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:33.992187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1ad66-001a-47b2-bf1e-822d2e70fc10 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:33.992444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1ad66-001a-47b2-bf1e-822d2e70fc10 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:33.993976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 205/420] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:19:34.000283 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f627-b918-4ae2-81c9-45bc24af1c4e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:34.000593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f627-b918-4ae2-81c9-45bc24af1c4e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:34.000838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f627-b918-4ae2-81c9-45bc24af1c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:34.033730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-73b6f627-b918-4ae2-81c9-45bc24af1c4e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:34.036355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:34.038472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-73b6f627-b918-4ae2-81c9-45bc24af1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:34.153370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 206/421] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:34.165362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc2d93-9ff9-4f54-bd99-3116754b60c0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:34.178175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6f627-b918-4ae2-81c9-45bc24af1c4e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:34.190380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:34.205981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebf5dc-5275-4106-8cc1-ad98ebf42eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:34.207461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebf5dc-5275-4106-8cc1-ad98ebf42eae None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:34.208187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebf5dc-5275-4106-8cc1-ad98ebf42eae None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:34.208751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebf5dc-5275-4106-8cc1-ad98ebf42eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:34.321264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebf5dc-5275-4106-8cc1-ad98ebf42eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:34.323722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebf5dc-5275-4106-8cc1-ad98ebf42eae None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:34.330580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6f627-b918-4ae2-81c9-45bc24af1c4e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:34.369823 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:34.423128 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a680e3-85d3-4d22-9d7f-8c846a83fe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:34.423855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a680e3-85d3-4d22-9d7f-8c846a83fe6a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:34.424138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a680e3-85d3-4d22-9d7f-8c846a83fe6a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:34.424408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a680e3-85d3-4d22-9d7f-8c846a83fe6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:34.456517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a680e3-85d3-4d22-9d7f-8c846a83fe6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:34.459148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 216/422] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-19a680e3-85d3-4d22-9d7f-8c846a83fe6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:34.465867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:34.466807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:34.467605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 207/423] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:34.469207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebf5dc-5275-4106-8cc1-ad98ebf42eae None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:34.471995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a680e3-85d3-4d22-9d7f-8c846a83fe6a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:34.608398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:34.631497 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebf5dc-5275-4106-8cc1-ad98ebf42eae None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:34.659192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:34.681994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a02c5-4b40-4265-80c2-b95685eaeb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:34.684954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a680e3-85d3-4d22-9d7f-8c846a83fe6a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:34.686764 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a02c5-4b40-4265-80c2-b95685eaeb50 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:34.687280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a02c5-4b40-4265-80c2-b95685eaeb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:34.688022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a02c5-4b40-4265-80c2-b95685eaeb50 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:34.691808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a02c5-4b40-4265-80c2-b95685eaeb50 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:34.706246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a02c5-4b40-4265-80c2-b95685eaeb50 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:34.710759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 217/424] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:34 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:34.717649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a02c5-4b40-4265-80c2-b95685eaeb50 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:34.779046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaae464-5785-45df-9271-bb42e1a1fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:34.779721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaae464-5785-45df-9271-bb42e1a1fc65 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:34.779998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaae464-5785-45df-9271-bb42e1a1fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:34.780271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaae464-5785-45df-9271-bb42e1a1fc65 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:34.781029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaae464-5785-45df-9271-bb42e1a1fc65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:34.781397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaae464-5785-45df-9271-bb42e1a1fc65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:34.790375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaae464-5785-45df-9271-bb42e1a1fc65 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:34.804958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 208/425] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:34.811824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaae464-5785-45df-9271-bb42e1a1fc65 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:34.881735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a02c5-4b40-4265-80c2-b95685eaeb50 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:34.927106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c9918-1068-4523-84a1-366037bd19d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:34.927975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c9918-1068-4523-84a1-366037bd19d3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:34.928542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c9918-1068-4523-84a1-366037bd19d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:34.928650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c9918-1068-4523-84a1-366037bd19d3 None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:34.931245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c9918-1068-4523-84a1-366037bd19d3 None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:34.932888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c9918-1068-4523-84a1-366037bd19d3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:34.935448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 218/426] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:34 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:34.940661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c9918-1068-4523-84a1-366037bd19d3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:34.969892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaae464-5785-45df-9271-bb42e1a1fc65 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:35.003305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:35.017280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d4b09-8467-43f4-912b-0920ad8cc23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:35.017856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d4b09-8467-43f4-912b-0920ad8cc23c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:35.018142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d4b09-8467-43f4-912b-0920ad8cc23c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:35.018450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d4b09-8467-43f4-912b-0920ad8cc23c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:35.076165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:35.108191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d4b09-8467-43f4-912b-0920ad8cc23c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:35.109666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d4b09-8467-43f4-912b-0920ad8cc23c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:35.213303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 209/427] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:35.216155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c9918-1068-4523-84a1-366037bd19d3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:35.218727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d4b09-8467-43f4-912b-0920ad8cc23c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:35.263664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:35.330501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d4b09-8467-43f4-912b-0920ad8cc23c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:35.343352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a121d9d-a385-4e40-af9d-16ae3fd387da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:35.343789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a121d9d-a385-4e40-af9d-16ae3fd387da None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:35.344073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a121d9d-a385-4e40-af9d-16ae3fd387da None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:35.344345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a121d9d-a385-4e40-af9d-16ae3fd387da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:35.345240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a121d9d-a385-4e40-af9d-16ae3fd387da None admin] RBAC: Adding query filter params (group.id=0cbe5108da3b496f96e80d990ed303ef, role.id=d3f29bc0265f45979298aa97cf42ee59, scope.project.id=0de6538741964c2b8766be7436e4800e) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:35.345485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a121d9d-a385-4e40-af9d-16ae3fd387da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:35.346962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a121d9d-a385-4e40-af9d-16ae3fd387da None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:35.365321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 219/428] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Jun 24 10:19:34 2022] GET /identity/v3/role_assignments?group.id=0cbe5108da3b496f96e80d990ed303ef&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=d3f29bc0265f45979298aa97cf42ee59 => generated 611 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:35.373477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d3276-941b-4a02-9d75-fed1a53685a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:35.374797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d3276-941b-4a02-9d75-fed1a53685a9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:35.375312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d3276-941b-4a02-9d75-fed1a53685a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:35.375790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d3276-941b-4a02-9d75-fed1a53685a9 None admin] PATH_INFO: `/v3/projects/0de6538741964c2b8766be7436e4800e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:35.377266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d3276-941b-4a02-9d75-fed1a53685a9 None admin] RBAC: Authorizing `identity:get_project(project_id=0de6538741964c2b8766be7436e4800e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:35.378991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d3276-941b-4a02-9d75-fed1a53685a9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:35.381308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 210/429] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:35 2022] GET /identity/v3/projects/0de6538741964c2b8766be7436e4800e => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:35.387051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a121d9d-a385-4e40-af9d-16ae3fd387da None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:35.532291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a121d9d-a385-4e40-af9d-16ae3fd387da None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:35.558825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:35.576054 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2535ca6-7c50-48c6-9edc-2e635b48abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:35.576667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2535ca6-7c50-48c6-9edc-2e635b48abc3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:35.576947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2535ca6-7c50-48c6-9edc-2e635b48abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:35.577219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2535ca6-7c50-48c6-9edc-2e635b48abc3 None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:35.578752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2535ca6-7c50-48c6-9edc-2e635b48abc3 None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:35.580181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2535ca6-7c50-48c6-9edc-2e635b48abc3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:35.582122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 220/430] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:35 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:35.587827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d3276-941b-4a02-9d75-fed1a53685a9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:35.698021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:35.702419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d3276-941b-4a02-9d75-fed1a53685a9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:35.716804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f12d4-93dd-4bc1-a7d3-e3e5721e397d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:35.717176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f12d4-93dd-4bc1-a7d3-e3e5721e397d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:35.717532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f12d4-93dd-4bc1-a7d3-e3e5721e397d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:35.719300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 221/431] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:19:35.725866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ce27-4b62-4ac5-bb93-ecae043074bd None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:35.726237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ce27-4b62-4ac5-bb93-ecae043074bd None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:35.726761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ce27-4b62-4ac5-bb93-ecae043074bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:35.751608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5a94ce27-4b62-4ac5-bb93-ecae043074bd None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:35.752935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5a94ce27-4b62-4ac5-bb93-ecae043074bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:35.755016 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472fec8-7c48-4fe1-aa76-46f8d279947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:35.757382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472fec8-7c48-4fe1-aa76-46f8d279947b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:35.757903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472fec8-7c48-4fe1-aa76-46f8d279947b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:35.758407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472fec8-7c48-4fe1-aa76-46f8d279947b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:35.759439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472fec8-7c48-4fe1-aa76-46f8d279947b None admin] RBAC: Adding query filter params (group.id=0cbe5108da3b496f96e80d990ed303ef, role.id=6c516ab551054fc8bd24c92c7d9173ba, scope.project.id=0de6538741964c2b8766be7436e4800e) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:35.759961 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472fec8-7c48-4fe1-aa76-46f8d279947b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:35.762174 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472fec8-7c48-4fe1-aa76-46f8d279947b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:35.771174 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 211/432] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Jun 24 10:19:35 2022] GET /identity/v3/role_assignments?group.id=0cbe5108da3b496f96e80d990ed303ef&scope.project.id=0de6538741964c2b8766be7436e4800e&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:35.837267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe139c19-7e98-45bf-af8d-8619b89cd613 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:35.837576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe139c19-7e98-45bf-af8d-8619b89cd613 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:35.837792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe139c19-7e98-45bf-af8d-8619b89cd613 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:35.840949 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 212/433] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:19:35.845669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f004f0-71f1-4e34-9f68-0b969893f6cb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:35.846018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f004f0-71f1-4e34-9f68-0b969893f6cb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:35.846306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f004f0-71f1-4e34-9f68-0b969893f6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:35.847427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 222/434] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:35.869249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-75f004f0-71f1-4e34-9f68-0b969893f6cb None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:35.871369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-75f004f0-71f1-4e34-9f68-0b969893f6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:35.878845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94ce27-4b62-4ac5-bb93-ecae043074bd None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:35.954234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 213/435] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:35.977967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f004f0-71f1-4e34-9f68-0b969893f6cb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:36.011917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94ce27-4b62-4ac5-bb93-ecae043074bd None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:36.038755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.056178 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc78b9-246f-4344-b4e8-092693a058e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:36.057356 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc78b9-246f-4344-b4e8-092693a058e5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.057847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc78b9-246f-4344-b4e8-092693a058e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.058130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc78b9-246f-4344-b4e8-092693a058e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:36.069121 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc78b9-246f-4344-b4e8-092693a058e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-1acc78b9-246f-4344-b4e8-092693a058e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:36.076847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:36.077732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 10:19:36.078640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:36.079240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 223/436] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:36.084826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc78b9-246f-4344-b4e8-092693a058e5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:36.098107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.106285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f004f0-71f1-4e34-9f68-0b969893f6cb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:36.146544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71e68-4327-41b3-b84f-cd096aa55689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:36.147365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71e68-4327-41b3-b84f-cd096aa55689 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.147714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71e68-4327-41b3-b84f-cd096aa55689 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.147996 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71e68-4327-41b3-b84f-cd096aa55689 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:36.159146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada71e68-4327-41b3-b84f-cd096aa55689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ada71e68-4327-41b3-b84f-cd096aa55689 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:36.167552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:36.168977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:36.169776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 214/437] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:36.176489 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71e68-4327-41b3-b84f-cd096aa55689 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:36.221065 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc78b9-246f-4344-b4e8-092693a058e5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:36.264345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23e79d-16b2-4478-957d-c355bb5863ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:36.265196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23e79d-16b2-4478-957d-c355bb5863ac None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.265574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23e79d-16b2-4478-957d-c355bb5863ac None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.265949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23e79d-16b2-4478-957d-c355bb5863ac None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:36.266913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23e79d-16b2-4478-957d-c355bb5863ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:36.267317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23e79d-16b2-4478-957d-c355bb5863ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:36.268756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23e79d-16b2-4478-957d-c355bb5863ac None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:36.280238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 224/438] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:19:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:36.286694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23e79d-16b2-4478-957d-c355bb5863ac None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:36.306217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71e68-4327-41b3-b84f-cd096aa55689 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:36.346415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.351354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ac559-9490-4f14-9c27-5ad7cde2eef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:36.352123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ac559-9490-4f14-9c27-5ad7cde2eef1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.352412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ac559-9490-4f14-9c27-5ad7cde2eef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.352700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ac559-9490-4f14-9c27-5ad7cde2eef1 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:36.353460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ac559-9490-4f14-9c27-5ad7cde2eef1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:36.353777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ac559-9490-4f14-9c27-5ad7cde2eef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:36.355247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ac559-9490-4f14-9c27-5ad7cde2eef1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:36.364400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 215/439] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:36.367681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38f680-233a-4e72-9383-b551e6b1eb64 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.367972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38f680-233a-4e72-9383-b551e6b1eb64 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.368254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38f680-233a-4e72-9383-b551e6b1eb64 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:36.369701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 216/440] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:36.370647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38f680-233a-4e72-9383-b551e6b1eb64 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:36.391381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.412131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23e79d-16b2-4478-957d-c355bb5863ac None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:36.455263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc62ab-6994-483c-a09a-8e5b1271d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:36.455918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc62ab-6994-483c-a09a-8e5b1271d43d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.456206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc62ab-6994-483c-a09a-8e5b1271d43d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.456479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc62ab-6994-483c-a09a-8e5b1271d43d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:36.487656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38f680-233a-4e72-9383-b551e6b1eb64 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:36.536365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875a71d-1769-472e-9a02-d12e069b5edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:36.537376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875a71d-1769-472e-9a02-d12e069b5edc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.537843 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875a71d-1769-472e-9a02-d12e069b5edc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.538269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875a71d-1769-472e-9a02-d12e069b5edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:36.545056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc62ab-6994-483c-a09a-8e5b1271d43d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:36.546532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc62ab-6994-483c-a09a-8e5b1271d43d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:36.587620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.606872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875a71d-1769-472e-9a02-d12e069b5edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:36.608262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875a71d-1769-472e-9a02-d12e069b5edc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:36.624520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.644144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 225/441] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:36.648936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52834c11-a659-4fa8-976c-52a1fc69ff29 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.648936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52834c11-a659-4fa8-976c-52a1fc69ff29 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.648936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52834c11-a659-4fa8-976c-52a1fc69ff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:36.662503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-52834c11-a659-4fa8-976c-52a1fc69ff29 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:36.665798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-52834c11-a659-4fa8-976c-52a1fc69ff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:36.712735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 217/442] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:36.713587 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875a71d-1769-472e-9a02-d12e069b5edc None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:36.732763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 226/443] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:36.733603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52834c11-a659-4fa8-976c-52a1fc69ff29 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:36.805009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.816052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875a71d-1769-472e-9a02-d12e069b5edc None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:36.833323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.834607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52834c11-a659-4fa8-976c-52a1fc69ff29 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:36.851631 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54e95c-442a-45ec-8dd0-9db2e0ee03ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:36.852484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54e95c-442a-45ec-8dd0-9db2e0ee03ab None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.852773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54e95c-442a-45ec-8dd0-9db2e0ee03ab None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.853052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54e95c-442a-45ec-8dd0-9db2e0ee03ab None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:36.854230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54e95c-442a-45ec-8dd0-9db2e0ee03ab None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:36.855765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54e95c-442a-45ec-8dd0-9db2e0ee03ab None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:36.857494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 218/444] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:36 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:36.858212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54e95c-442a-45ec-8dd0-9db2e0ee03ab None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:36.874370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071a29b-cb3a-4410-9b2f-f8d8b6a8841e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:36.875228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071a29b-cb3a-4410-9b2f-f8d8b6a8841e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.875518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071a29b-cb3a-4410-9b2f-f8d8b6a8841e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.875796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071a29b-cb3a-4410-9b2f-f8d8b6a8841e None admin] PATH_INFO: `/v3/projects/f21952e768e3457caaf57d70eb4dc55f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:36.876963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071a29b-cb3a-4410-9b2f-f8d8b6a8841e None admin] RBAC: Authorizing `identity:get_project(project_id=f21952e768e3457caaf57d70eb4dc55f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:36.878442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071a29b-cb3a-4410-9b2f-f8d8b6a8841e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:36.880128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 227/445] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:36 2022] GET /identity/v3/projects/f21952e768e3457caaf57d70eb4dc55f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:36.880956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071a29b-cb3a-4410-9b2f-f8d8b6a8841e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:36.959437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54e95c-442a-45ec-8dd0-9db2e0ee03ab None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:36.978797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071a29b-cb3a-4410-9b2f-f8d8b6a8841e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:36.993507 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ff6e-9e34-42f7-ae68-37a2d93974f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:36.994293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ff6e-9e34-42f7-ae68-37a2d93974f9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:36.994610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ff6e-9e34-42f7-ae68-37a2d93974f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:36.994887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ff6e-9e34-42f7-ae68-37a2d93974f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:37.005076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6ff6e-9e34-42f7-ae68-37a2d93974f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:37.011341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d8486-14f6-4c42-b838-7fa0a08f8d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:37.013656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8486-14f6-4c42-b838-7fa0a08f8d63 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:37.013656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8486-14f6-4c42-b838-7fa0a08f8d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:37.013656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8486-14f6-4c42-b838-7fa0a08f8d63 None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-3ba6ff6e-9e34-42f7-ae68-37a2d93974f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:37.013947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:37.015103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:37.015901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 219/446] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:19:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:37.016552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d8486-14f6-4c42-b838-7fa0a08f8d63 None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:37.016619 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ff6e-9e34-42f7-ae68-37a2d93974f9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:37.016692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d8486-14f6-4c42-b838-7fa0a08f8d63 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:37.017773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 228/447] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:36 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:37.020144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d8486-14f6-4c42-b838-7fa0a08f8d63 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:37.030756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:37.065654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:37.119179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ff6e-9e34-42f7-ae68-37a2d93974f9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:37.119551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d8486-14f6-4c42-b838-7fa0a08f8d63 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:37.152192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032b80a-05e8-4437-b45f-71998e7c6f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:37.152691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a4c03-0260-443a-b30b-693982813dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:37.153044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b80a-05e8-4437-b45f-71998e7c6f1d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:37.153170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a4c03-0260-443a-b30b-693982813dde None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:37.153356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b80a-05e8-4437-b45f-71998e7c6f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:37.153452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a4c03-0260-443a-b30b-693982813dde None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:37.153594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b80a-05e8-4437-b45f-71998e7c6f1d None admin] PATH_INFO: `/v3/groups/0cbe5108da3b496f96e80d990ed303ef` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:37.153715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a4c03-0260-443a-b30b-693982813dde None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:37.154488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a4c03-0260-443a-b30b-693982813dde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:37.154793 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a4c03-0260-443a-b30b-693982813dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:37.154879 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032b80a-05e8-4437-b45f-71998e7c6f1d None admin] RBAC: Authorizing `identity:get_group(group_id=0cbe5108da3b496f96e80d990ed303ef)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:37.156142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a4c03-0260-443a-b30b-693982813dde None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:37.156226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032b80a-05e8-4437-b45f-71998e7c6f1d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:37.157820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 220/448] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:37 2022] GET /identity/v3/groups/0cbe5108da3b496f96e80d990ed303ef => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:37.161621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032b80a-05e8-4437-b45f-71998e7c6f1d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:37.168702 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 229/449] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:37.168702 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a4c03-0260-443a-b30b-693982813dde None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:37.233252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:37.258540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032b80a-05e8-4437-b45f-71998e7c6f1d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:37.264714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a4c03-0260-443a-b30b-693982813dde None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:37.271725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:37.292728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07259be6-3b72-49f6-931c-056f1f7e822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:37.293376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07259be6-3b72-49f6-931c-056f1f7e822b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:37.293663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07259be6-3b72-49f6-931c-056f1f7e822b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:37.293941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07259be6-3b72-49f6-931c-056f1f7e822b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:37.294794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07259be6-3b72-49f6-931c-056f1f7e822b None admin] RBAC: Adding query filter params (group.id=0cbe5108da3b496f96e80d990ed303ef, role.id=6c516ab551054fc8bd24c92c7d9173ba, scope.project.id=f21952e768e3457caaf57d70eb4dc55f) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:37.295107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07259be6-3b72-49f6-931c-056f1f7e822b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:37.296535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07259be6-3b72-49f6-931c-056f1f7e822b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:37.298168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efd63a-9f23-4990-b7af-5d414b2034cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:37.298838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efd63a-9f23-4990-b7af-5d414b2034cc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:37.299130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efd63a-9f23-4990-b7af-5d414b2034cc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:37.299436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efd63a-9f23-4990-b7af-5d414b2034cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:37.300525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efd63a-9f23-4990-b7af-5d414b2034cc None admin] RBAC: Adding query filter params (group.id=0cbe5108da3b496f96e80d990ed303ef, role.id=d3f29bc0265f45979298aa97cf42ee59, scope.project.id=f21952e768e3457caaf57d70eb4dc55f) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:37.300841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efd63a-9f23-4990-b7af-5d414b2034cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:37.302241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efd63a-9f23-4990-b7af-5d414b2034cc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:37.302634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 221/450] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Jun 24 10:19:37 2022] GET /identity/v3/role_assignments?group.id=0cbe5108da3b496f96e80d990ed303ef&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=6c516ab551054fc8bd24c92c7d9173ba => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:37.303400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07259be6-3b72-49f6-931c-056f1f7e822b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:37.309232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 230/451] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Jun 24 10:19:37 2022] GET /identity/v3/role_assignments?group.id=0cbe5108da3b496f96e80d990ed303ef&scope.project.id=f21952e768e3457caaf57d70eb4dc55f&role.id=d3f29bc0265f45979298aa97cf42ee59 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:37.421299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07259be6-3b72-49f6-931c-056f1f7e822b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:37.460653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9330325-f096-4c2c-b5d0-54678bfeb629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:37.461323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9330325-f096-4c2c-b5d0-54678bfeb629 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:37.461613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9330325-f096-4c2c-b5d0-54678bfeb629 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:37.461888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9330325-f096-4c2c-b5d0-54678bfeb629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:37.515485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:37.540057 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9330325-f096-4c2c-b5d0-54678bfeb629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:37.541534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9330325-f096-4c2c-b5d0-54678bfeb629 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:37.648558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 222/452] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:37.654336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efd63a-9f23-4990-b7af-5d414b2034cc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:37.754866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efd63a-9f23-4990-b7af-5d414b2034cc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:37.788106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d64b5b-7786-4efd-a97b-10787d4b115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:37.788978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d64b5b-7786-4efd-a97b-10787d4b115b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:37.789264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d64b5b-7786-4efd-a97b-10787d4b115b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:37.790020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d64b5b-7786-4efd-a97b-10787d4b115b None admin] PATH_INFO: `/v3/projects/f43b9dcf7aae4875bca38a800d08c70f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:37.790889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d64b5b-7786-4efd-a97b-10787d4b115b None admin] RBAC: Authorizing `identity:get_project(project_id=f43b9dcf7aae4875bca38a800d08c70f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:37.792331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d64b5b-7786-4efd-a97b-10787d4b115b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:37.794610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 231/453] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:19:37 2022] GET /identity/v3/projects/f43b9dcf7aae4875bca38a800d08c70f => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:37.800289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9330325-f096-4c2c-b5d0-54678bfeb629 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:37.876625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:37.898884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9330325-f096-4c2c-b5d0-54678bfeb629 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:37.932551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45318415-2491-440a-b8cb-830fbb776d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:37.933430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318415-2491-440a-b8cb-830fbb776d91 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:37.933715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318415-2491-440a-b8cb-830fbb776d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:37.933995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318415-2491-440a-b8cb-830fbb776d91 None admin] PATH_INFO: `/v3/groups/a28d61d3970c4ad1940b03bd5b634843` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:37.935173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45318415-2491-440a-b8cb-830fbb776d91 None admin] RBAC: Authorizing `identity:get_group(group_id=a28d61d3970c4ad1940b03bd5b634843)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:37.936622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45318415-2491-440a-b8cb-830fbb776d91 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:37.938262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 223/454] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Jun 24 10:19:37 2022] GET /identity/v3/groups/a28d61d3970c4ad1940b03bd5b634843 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:37.944036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d64b5b-7786-4efd-a97b-10787d4b115b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:37.946898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:38.043319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d64b5b-7786-4efd-a97b-10787d4b115b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:38.079744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279988-31cc-4fe8-9a0c-d010849b8025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:38.080388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279988-31cc-4fe8-9a0c-d010849b8025 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:38.080674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279988-31cc-4fe8-9a0c-d010849b8025 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:38.080952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279988-31cc-4fe8-9a0c-d010849b8025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:38.081778 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279988-31cc-4fe8-9a0c-d010849b8025 None admin] RBAC: Adding query filter params (group.id=a28d61d3970c4ad1940b03bd5b634843, role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=f43b9dcf7aae4875bca38a800d08c70f) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:38.082093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279988-31cc-4fe8-9a0c-d010849b8025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:38.083553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279988-31cc-4fe8-9a0c-d010849b8025 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:38.089334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 232/455] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Jun 24 10:19:37 2022] GET /identity/v3/role_assignments?group.id=a28d61d3970c4ad1940b03bd5b634843&scope.project.id=f43b9dcf7aae4875bca38a800d08c70f&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:40.635141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0f08-5f39-472d-acfb-d4ca40f31b13 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:40.636131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0f08-5f39-472d-acfb-d4ca40f31b13 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:40.636632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa0f08-5f39-472d-acfb-d4ca40f31b13 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:40.637677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500148ba-3929-4da0-89ce-d96626ce1138 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:40.638472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 224/456] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:40.638795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500148ba-3929-4da0-89ce-d96626ce1138 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:40.639406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500148ba-3929-4da0-89ce-d96626ce1138 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:40.641207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 233/457] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:40.643931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac6fe9-ff45-450a-a704-a01f5067f6dc None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:40.644214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac6fe9-ff45-450a-a704-a01f5067f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:40.644488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac6fe9-ff45-450a-a704-a01f5067f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:40.647332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318555-3ffb-48ad-b74e-4afa828fade3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:40.647838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318555-3ffb-48ad-b74e-4afa828fade3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:40.648340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318555-3ffb-48ad-b74e-4afa828fade3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:40.672564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9aac6fe9-ff45-450a-a704-a01f5067f6dc None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:40.673760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9aac6fe9-ff45-450a-a704-a01f5067f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:40.679643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-72318555-3ffb-48ad-b74e-4afa828fade3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:40.680822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-72318555-3ffb-48ad-b74e-4afa828fade3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:40.796496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:40.804558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 225/458] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:40.812890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 234/459] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:40.837081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac6fe9-ff45-450a-a704-a01f5067f6dc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:40.844583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318555-3ffb-48ad-b74e-4afa828fade3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:40.922114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:40.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac6fe9-ff45-450a-a704-a01f5067f6dc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:40.965163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318555-3ffb-48ad-b74e-4afa828fade3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:41.000005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204c8be-b75c-4fbd-af37-7be253b1e60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:41.000811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204c8be-b75c-4fbd-af37-7be253b1e60f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.001099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204c8be-b75c-4fbd-af37-7be253b1e60f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.001378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204c8be-b75c-4fbd-af37-7be253b1e60f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.026378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204c8be-b75c-4fbd-af37-7be253b1e60f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:41.027919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204c8be-b75c-4fbd-af37-7be253b1e60f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:41.040317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57158cd0-d4cd-4ca5-851f-9ca0dc62d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:41.041124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57158cd0-d4cd-4ca5-851f-9ca0dc62d3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.041412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57158cd0-d4cd-4ca5-851f-9ca0dc62d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.041692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57158cd0-d4cd-4ca5-851f-9ca0dc62d3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.060550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57158cd0-d4cd-4ca5-851f-9ca0dc62d3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:41.062025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57158cd0-d4cd-4ca5-851f-9ca0dc62d3f5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1204c8be-b75c-4fbd-af37-7be253b1e60f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:41.067571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:41.068459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:41.069320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:41.069320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:41.069320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:41.069320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:41.081287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 226/460] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-57158cd0-d4cd-4ca5-851f-9ca0dc62d3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:41.092809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:41.093652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:41.094534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:41.094534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:41.094534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:41.094534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:41.095422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204c8be-b75c-4fbd-af37-7be253b1e60f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:41.106459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 235/461] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:41.114857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57158cd0-d4cd-4ca5-851f-9ca0dc62d3f5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:41.179161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:41.216564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204c8be-b75c-4fbd-af37-7be253b1e60f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:41.239254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57158cd0-d4cd-4ca5-851f-9ca0dc62d3f5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:41.242098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:41.252521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cab87-0871-445f-8328-a5974ee31fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:41.253390 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cab87-0871-445f-8328-a5974ee31fec None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.253865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cab87-0871-445f-8328-a5974ee31fec None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.254422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cab87-0871-445f-8328-a5974ee31fec None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.255339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cab87-0871-445f-8328-a5974ee31fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:41.255815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cab87-0871-445f-8328-a5974ee31fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:41.257386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cab87-0871-445f-8328-a5974ee31fec None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:41.275597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded91502-a2dc-4baa-a7ff-0e874c19bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:41.275886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 227/462] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:41.277073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acbebc-6291-4da0-928b-7ad67cc5e454 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.277358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acbebc-6291-4da0-928b-7ad67cc5e454 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.277634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acbebc-6291-4da0-928b-7ad67cc5e454 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.282773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 228/463] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:41.282773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf96bb-0715-44c1-9085-ee12f6facb1e None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.282773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf96bb-0715-44c1-9085-ee12f6facb1e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.282773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf96bb-0715-44c1-9085-ee12f6facb1e None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.283077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded91502-a2dc-4baa-a7ff-0e874c19bc24 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.283077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded91502-a2dc-4baa-a7ff-0e874c19bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.283077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded91502-a2dc-4baa-a7ff-0e874c19bc24 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.283077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded91502-a2dc-4baa-a7ff-0e874c19bc24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:41.283320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded91502-a2dc-4baa-a7ff-0e874c19bc24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:41.284736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded91502-a2dc-4baa-a7ff-0e874c19bc24 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:41.285645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 229/464] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:41.286758 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf96bb-0715-44c1-9085-ee12f6facb1e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:41.297445 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 236/465] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:41.299801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fe144-7ee9-488e-9bbc-fd0b181e8888 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.300684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fe144-7ee9-488e-9bbc-fd0b181e8888 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.301110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fe144-7ee9-488e-9bbc-fd0b181e8888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.318290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c80fe144-7ee9-488e-9bbc-fd0b181e8888 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:41.319497 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c80fe144-7ee9-488e-9bbc-fd0b181e8888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:41.385890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 237/466] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:41.387305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f65868-3d8a-456f-849f-4fdf68cf86d6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.387599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f65868-3d8a-456f-849f-4fdf68cf86d6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.387881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f65868-3d8a-456f-849f-4fdf68cf86d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.403745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-32f65868-3d8a-456f-849f-4fdf68cf86d6 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:41.405187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-32f65868-3d8a-456f-849f-4fdf68cf86d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:41.407060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf96bb-0715-44c1-9085-ee12f6facb1e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:41.437789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:41.446689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee3c3e-0094-48e2-8954-d25c0d24dfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:41.447365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee3c3e-0094-48e2-8954-d25c0d24dfd4 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.447648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee3c3e-0094-48e2-8954-d25c0d24dfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.447924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee3c3e-0094-48e2-8954-d25c0d24dfd4 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.448678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee3c3e-0094-48e2-8954-d25c0d24dfd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:41.450575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee3c3e-0094-48e2-8954-d25c0d24dfd4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:41.471197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 230/467] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:19:41 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:19:41.471988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee3c3e-0094-48e2-8954-d25c0d24dfd4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:41.498788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 238/468] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:41.499826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f65868-3d8a-456f-849f-4fdf68cf86d6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:41.583069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:41.704164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee3c3e-0094-48e2-8954-d25c0d24dfd4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:41.709310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f65868-3d8a-456f-849f-4fdf68cf86d6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:41.755112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a7d88-60ca-4e9c-8583-2bee75050dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:41.755315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a7d88-60ca-4e9c-8583-2bee75050dc4 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.755644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a7d88-60ca-4e9c-8583-2bee75050dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.755825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a7d88-60ca-4e9c-8583-2bee75050dc4 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.756935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a7d88-60ca-4e9c-8583-2bee75050dc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:41.757917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a7d88-60ca-4e9c-8583-2bee75050dc4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:41.761950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a8d54-4d89-4855-b865-59d6399f1346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:41.762781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a8d54-4d89-4855-b865-59d6399f1346 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.763059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a8d54-4d89-4855-b865-59d6399f1346 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.763331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a8d54-4d89-4855-b865-59d6399f1346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:41.785032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a8d54-4d89-4855-b865-59d6399f1346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:41.787735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a8d54-4d89-4855-b865-59d6399f1346 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:41.788932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 231/469] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:19:41 2022] POST /identity/v3/users => generated 248 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:19:41.790047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a7d88-60ca-4e9c-8583-2bee75050dc4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-701a8d54-4d89-4855-b865-59d6399f1346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:41.841711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:41.842664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:41.843495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:41.843495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:41.843495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:41.843495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:41.843495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 239/470] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:41.847723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a8d54-4d89-4855-b865-59d6399f1346 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:41.920816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:41.932120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:41.939395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a7d88-60ca-4e9c-8583-2bee75050dc4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:41.988390 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975ad7-d42c-4656-9093-38b686a6926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:41.989635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975ad7-d42c-4656-9093-38b686a6926b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:41.990184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975ad7-d42c-4656-9093-38b686a6926b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:41.990964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975ad7-d42c-4656-9093-38b686a6926b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:42.017201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3975ad7-d42c-4656-9093-38b686a6926b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:42.022308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3975ad7-d42c-4656-9093-38b686a6926b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b3975ad7-d42c-4656-9093-38b686a6926b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:42.049388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:42.050636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:42.051497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:42.051497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:42.051497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:42.051497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:42.051497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 232/471] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:42.052985 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078a08-0877-4fc4-92dc-742a94f90464 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:42.053228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078a08-0877-4fc4-92dc-742a94f90464 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:42.053513 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078a08-0877-4fc4-92dc-742a94f90464 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:42.055723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 233/472] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:42.059202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078a08-0877-4fc4-92dc-742a94f90464 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:42.098324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a8d54-4d89-4855-b865-59d6399f1346 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:42.139382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2556781-9c76-4403-9e56-e1e3a93a4c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:42.139742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556781-9c76-4403-9e56-e1e3a93a4c88 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:42.140135 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556781-9c76-4403-9e56-e1e3a93a4c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:42.140402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556781-9c76-4403-9e56-e1e3a93a4c88 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:42.141147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2556781-9c76-4403-9e56-e1e3a93a4c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:42.141433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2556781-9c76-4403-9e56-e1e3a93a4c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:42.142892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2556781-9c76-4403-9e56-e1e3a93a4c88 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:42.156921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 240/473] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:42.158202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18046c-1134-4be1-8d35-09e866cc1b8b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:42.158518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18046c-1134-4be1-8d35-09e866cc1b8b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:42.158796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18046c-1134-4be1-8d35-09e866cc1b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:42.180308 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1e18046c-1134-4be1-8d35-09e866cc1b8b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:42.181549 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1e18046c-1134-4be1-8d35-09e866cc1b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:42.193103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078a08-0877-4fc4-92dc-742a94f90464 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:42.236582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96e1ae-d20a-479d-8a61-1ee0c9c1e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:42.237895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96e1ae-d20a-479d-8a61-1ee0c9c1e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:42.238510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96e1ae-d20a-479d-8a61-1ee0c9c1e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:42.238962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96e1ae-d20a-479d-8a61-1ee0c9c1e4f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:42.239863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96e1ae-d20a-479d-8a61-1ee0c9c1e4f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:42.240359 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96e1ae-d20a-479d-8a61-1ee0c9c1e4f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:42.242492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96e1ae-d20a-479d-8a61-1ee0c9c1e4f4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:42.257234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 241/474] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:42.258198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18046c-1134-4be1-8d35-09e866cc1b8b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:42.259194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 234/475] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:42.264206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96e1ae-d20a-479d-8a61-1ee0c9c1e4f4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:42.271196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:42.280636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:42.375854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18046c-1134-4be1-8d35-09e866cc1b8b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:42.401180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96e1ae-d20a-479d-8a61-1ee0c9c1e4f4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:42.415487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acacacb-ea21-4e47-a380-24e0c3ad0d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:42.416527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acacacb-ea21-4e47-a380-24e0c3ad0d66 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:42.416951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acacacb-ea21-4e47-a380-24e0c3ad0d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:42.417985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acacacb-ea21-4e47-a380-24e0c3ad0d66 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:42.418950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acacacb-ea21-4e47-a380-24e0c3ad0d66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:42.420762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acacacb-ea21-4e47-a380-24e0c3ad0d66 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:42.443934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc8013-d45c-45a5-b36e-cff1939ed745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:42.444597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8013-d45c-45a5-b36e-cff1939ed745 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:42.444888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8013-d45c-45a5-b36e-cff1939ed745 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:42.445167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8013-d45c-45a5-b36e-cff1939ed745 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:42.445984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc8013-d45c-45a5-b36e-cff1939ed745 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:42.447481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc8013-d45c-45a5-b36e-cff1939ed745 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:42.454692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 242/476] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:19:42 2022] POST /identity/v3/users => generated 249 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:19:42.456552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acacacb-ea21-4e47-a380-24e0c3ad0d66 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:42.482990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 235/477] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:19:42 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:19:42.547041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:42.612427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acacacb-ea21-4e47-a380-24e0c3ad0d66 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:42.667252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d3590-5ce2-4529-b7f6-0dec55f76905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:42.668383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d3590-5ce2-4529-b7f6-0dec55f76905 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:42.668678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d3590-5ce2-4529-b7f6-0dec55f76905 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:42.668953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d3590-5ce2-4529-b7f6-0dec55f76905 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:42.670193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d3590-5ce2-4529-b7f6-0dec55f76905 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:42.671099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d3590-5ce2-4529-b7f6-0dec55f76905 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:42.679187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.sql.core [None req-341d3590-5ce2-4529-b7f6-0dec55f76905 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 10:19:42.679187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 10:19:42.679187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [parameters: {'id': '49ba4d9d41d14e0caf8e364b039daedf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 10:19:42.679187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80112) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-341d3590-5ce2-4529-b7f6-0dec55f76905 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application result.read() Jun 24 10:19:42.695636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:19:42.696578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application yield resource Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise self.value Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application session.commit() Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 10:19:42.697472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self.session.flush() Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application compat.raise_( Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 10:19:42.698340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:19:42.700020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application result.read() Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:19:42.700826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [parameters: {'id': '49ba4d9d41d14e0caf8e364b039daedf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:42.703025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 10:19:42.704753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:42.706610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 243/478] 10.222.0.44 () {60 vars in 1131 bytes} [Fri Jun 24 10:19:42 2022] POST /identity/v3/roles => generated 144 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:42.706736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc8013-d45c-45a5-b36e-cff1939ed745 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:42.790602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:42.830598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc8013-d45c-45a5-b36e-cff1939ed745 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:42.865559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684028a-1c7a-4776-b1b6-d0d61ec4738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:42.866378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684028a-1c7a-4776-b1b6-d0d61ec4738b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:42.866676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684028a-1c7a-4776-b1b6-d0d61ec4738b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:42.866954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684028a-1c7a-4776-b1b6-d0d61ec4738b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:42.877710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684028a-1c7a-4776-b1b6-d0d61ec4738b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-9684028a-1c7a-4776-b1b6-d0d61ec4738b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:42.886400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:42.887267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:42.888317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 236/479] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:19:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:42.894985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d3590-5ce2-4529-b7f6-0dec55f76905 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:43.013842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d3590-5ce2-4529-b7f6-0dec55f76905 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:43.048786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:43.054910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b8e11-0aee-4d39-a4a9-ff7976676176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:43.055588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8e11-0aee-4d39-a4a9-ff7976676176 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:43.055875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8e11-0aee-4d39-a4a9-ff7976676176 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:43.056153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8e11-0aee-4d39-a4a9-ff7976676176 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:43.056904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b8e11-0aee-4d39-a4a9-ff7976676176 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:43.057216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b8e11-0aee-4d39-a4a9-ff7976676176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:43.058726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b8e11-0aee-4d39-a4a9-ff7976676176 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:43.070150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 244/480] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:43.910922 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401a9c-ec82-413e-9e67-7f947a697305 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:43.911898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401a9c-ec82-413e-9e67-7f947a697305 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:43.912403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401a9c-ec82-413e-9e67-7f947a697305 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:43.914188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 237/481] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:43.919752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77afa8-09c6-4ecf-b9b0-003223d5729b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:43.920588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77afa8-09c6-4ecf-b9b0-003223d5729b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:43.921065 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77afa8-09c6-4ecf-b9b0-003223d5729b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:43.951364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-cf77afa8-09c6-4ecf-b9b0-003223d5729b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:43.952907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cf77afa8-09c6-4ecf-b9b0-003223d5729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:44.059698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 245/482] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:44.087411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401a9c-ec82-413e-9e67-7f947a697305 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:44.208487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0976c6e-3501-4fbb-b061-5b183dedd43b None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:44.208795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0976c6e-3501-4fbb-b061-5b183dedd43b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:44.208977 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0976c6e-3501-4fbb-b061-5b183dedd43b None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:44.214121 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 246/483] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:44.215297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645b2bd-d859-45e6-be7b-6c6fa4d669dd None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:44.215585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645b2bd-d859-45e6-be7b-6c6fa4d669dd None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:44.215860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645b2bd-d859-45e6-be7b-6c6fa4d669dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:44.242928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1645b2bd-d859-45e6-be7b-6c6fa4d669dd None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:44.244123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1645b2bd-d859-45e6-be7b-6c6fa4d669dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:44.259482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401a9c-ec82-413e-9e67-7f947a697305 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:44.307771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:44.328400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d82c1-b191-48ec-af6d-0237777ddf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:44.329197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d82c1-b191-48ec-af6d-0237777ddf1c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:44.329482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d82c1-b191-48ec-af6d-0237777ddf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:44.329758 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d82c1-b191-48ec-af6d-0237777ddf1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:44.355006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d82c1-b191-48ec-af6d-0237777ddf1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b55d82c1-b191-48ec-af6d-0237777ddf1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:44.365367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:44.366240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:44.367070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:44.374487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 238/484] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:44.375319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d82c1-b191-48ec-af6d-0237777ddf1c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:44.383750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 247/485] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:44.426264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645b2bd-d859-45e6-be7b-6c6fa4d669dd None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:44.532899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:44.537496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d82c1-b191-48ec-af6d-0237777ddf1c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:44.606218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7dcaa-5beb-46f0-877a-4cd2375b230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:44.607699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7dcaa-5beb-46f0-877a-4cd2375b230c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:44.608138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7dcaa-5beb-46f0-877a-4cd2375b230c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:44.608561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7dcaa-5beb-46f0-877a-4cd2375b230c None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:44.609466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7dcaa-5beb-46f0-877a-4cd2375b230c None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:44.609920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7dcaa-5beb-46f0-877a-4cd2375b230c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:44.611570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7dcaa-5beb-46f0-877a-4cd2375b230c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:44.621830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 239/486] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:44.627515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7dcaa-5beb-46f0-877a-4cd2375b230c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:44.646139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645b2bd-d859-45e6-be7b-6c6fa4d669dd None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:44.716124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be573a27-efa5-4def-8094-bab53ecf5f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:44.716927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573a27-efa5-4def-8094-bab53ecf5f8c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:44.717212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573a27-efa5-4def-8094-bab53ecf5f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:44.717487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573a27-efa5-4def-8094-bab53ecf5f8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:44.722540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:44.743408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be573a27-efa5-4def-8094-bab53ecf5f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-be573a27-efa5-4def-8094-bab53ecf5f8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:44.763963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:44.764931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:44.765759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 248/487] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:44.777967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be573a27-efa5-4def-8094-bab53ecf5f8c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:44.835020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7dcaa-5beb-46f0-877a-4cd2375b230c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:44.911538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3c7ad-7671-4a2d-a860-95f48224e335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:44.913663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3c7ad-7671-4a2d-a860-95f48224e335 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:44.914432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3c7ad-7671-4a2d-a860-95f48224e335 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:44.914924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3c7ad-7671-4a2d-a860-95f48224e335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:44.921580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be573a27-efa5-4def-8094-bab53ecf5f8c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:44.935998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:44.940646 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3c7ad-7671-4a2d-a860-95f48224e335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:44.942123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3c7ad-7671-4a2d-a860-95f48224e335 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:44.959751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069a499-0992-4a0b-abd1-c19f6b84cbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:44.960710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a499-0992-4a0b-abd1-c19f6b84cbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:44.961219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a499-0992-4a0b-abd1-c19f6b84cbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:44.961692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a499-0992-4a0b-abd1-c19f6b84cbd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:44.962721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069a499-0992-4a0b-abd1-c19f6b84cbd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:44.963247 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069a499-0992-4a0b-abd1-c19f6b84cbd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-35a3c7ad-7671-4a2d-a860-95f48224e335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:44.964530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:44.965372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:44.966644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:44.966644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:44.966644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:44.966644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:44.966644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 240/488] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:44.967501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069a499-0992-4a0b-abd1-c19f6b84cbd2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:44.971422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3c7ad-7671-4a2d-a860-95f48224e335 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:44.977541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 249/489] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:44.986833 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069a499-0992-4a0b-abd1-c19f6b84cbd2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:45.133625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:45.137485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3c7ad-7671-4a2d-a860-95f48224e335 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:45.164102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069a499-0992-4a0b-abd1-c19f6b84cbd2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:45.174640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f0f15-6ae5-4336-b566-c387a70df19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:45.175584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f0f15-6ae5-4336-b566-c387a70df19b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.176098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f0f15-6ae5-4336-b566-c387a70df19b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.176551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f0f15-6ae5-4336-b566-c387a70df19b None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.177569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f0f15-6ae5-4336-b566-c387a70df19b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:45.178101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f0f15-6ae5-4336-b566-c387a70df19b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:45.179883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f0f15-6ae5-4336-b566-c387a70df19b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:45.194180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 241/490] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:45.195905 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a24da9-01ad-4607-be8f-8b52e0b28f3e None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.196336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a24da9-01ad-4607-be8f-8b52e0b28f3e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.196752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a24da9-01ad-4607-be8f-8b52e0b28f3e None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.198667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 242/491] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:45.200369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a24da9-01ad-4607-be8f-8b52e0b28f3e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:45.207941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f50b5-f2e4-4515-9575-68569e27c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:45.208861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f50b5-f2e4-4515-9575-68569e27c0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.209241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f50b5-f2e4-4515-9575-68569e27c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.210110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f50b5-f2e4-4515-9575-68569e27c0d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.223964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f50b5-f2e4-4515-9575-68569e27c0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:45.226327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f50b5-f2e4-4515-9575-68569e27c0d4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-448f50b5-f2e4-4515-9575-68569e27c0d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:45.250061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:45.251116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:45.251945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:45.251945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:45.251945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:45.251945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:45.252502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 250/492] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:45.254025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c807-2aab-425e-a8ea-52ced9773519 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.254388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c807-2aab-425e-a8ea-52ced9773519 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.254739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c807-2aab-425e-a8ea-52ced9773519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.273458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a884c807-2aab-425e-a8ea-52ced9773519 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:45.274661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a884c807-2aab-425e-a8ea-52ced9773519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:45.297877 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:45.312547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a24da9-01ad-4607-be8f-8b52e0b28f3e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:45.347645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff04e2-a28a-4bdc-9bc5-afdea87dc5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:45.348465 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff04e2-a28a-4bdc-9bc5-afdea87dc5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.348754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff04e2-a28a-4bdc-9bc5-afdea87dc5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.349032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff04e2-a28a-4bdc-9bc5-afdea87dc5d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.355127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 251/493] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:45.355127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884c807-2aab-425e-a8ea-52ced9773519 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:45.361727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff04e2-a28a-4bdc-9bc5-afdea87dc5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:45.363455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff04e2-a28a-4bdc-9bc5-afdea87dc5d8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ffff04e2-a28a-4bdc-9bc5-afdea87dc5d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:45.381395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:45.382528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:45.383458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 243/494] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Jun 24 10:19:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:45.384137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32d806-4d57-414d-96f6-a09629964bee None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.384381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32d806-4d57-414d-96f6-a09629964bee None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.384668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32d806-4d57-414d-96f6-a09629964bee None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.390396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 244/495] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:45.390396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32d806-4d57-414d-96f6-a09629964bee None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:45.411071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:45.485986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884c807-2aab-425e-a8ea-52ced9773519 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:45.497255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32d806-4d57-414d-96f6-a09629964bee None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:45.519752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8000725-6dd0-4f5b-94e4-647bb021fde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:45.520418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000725-6dd0-4f5b-94e4-647bb021fde3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.520703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000725-6dd0-4f5b-94e4-647bb021fde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.520979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000725-6dd0-4f5b-94e4-647bb021fde3 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.521695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8000725-6dd0-4f5b-94e4-647bb021fde3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:45.522000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8000725-6dd0-4f5b-94e4-647bb021fde3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:45.523440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8000725-6dd0-4f5b-94e4-647bb021fde3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:45.535115 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 252/496] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:45.535920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8000725-6dd0-4f5b-94e4-647bb021fde3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:45.543990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3797d87-db3e-4e69-bac6-a9d1d4508ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:45.544793 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3797d87-db3e-4e69-bac6-a9d1d4508ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.545078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3797d87-db3e-4e69-bac6-a9d1d4508ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.545632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3797d87-db3e-4e69-bac6-a9d1d4508ad6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.555752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:45.557664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3797d87-db3e-4e69-bac6-a9d1d4508ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c3797d87-db3e-4e69-bac6-a9d1d4508ad6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:45.565453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:45.566336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:45.567611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 245/497] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:45.568551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ea84d-f76b-4e4f-bad7-34284a4f59ec None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.568638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ea84d-f76b-4e4f-bad7-34284a4f59ec None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.568893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ea84d-f76b-4e4f-bad7-34284a4f59ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.589360 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ca1ea84d-f76b-4e4f-bad7-34284a4f59ec None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:45.590905 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ca1ea84d-f76b-4e4f-bad7-34284a4f59ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:45.655453 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8000725-6dd0-4f5b-94e4-647bb021fde3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:45.670382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 246/498] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:45.670382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ea84d-f76b-4e4f-bad7-34284a4f59ec None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:45.678928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:45.706687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96daeb-ce5f-4876-9b2a-c28a8170e46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:45.707454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96daeb-ce5f-4876-9b2a-c28a8170e46a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.707749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96daeb-ce5f-4876-9b2a-c28a8170e46a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.708030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96daeb-ce5f-4876-9b2a-c28a8170e46a None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.708872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96daeb-ce5f-4876-9b2a-c28a8170e46a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:45.709188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96daeb-ce5f-4876-9b2a-c28a8170e46a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:45.710657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96daeb-ce5f-4876-9b2a-c28a8170e46a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:45.752354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 253/499] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Jun 24 10:19:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:45.752354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96daeb-ce5f-4876-9b2a-c28a8170e46a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:45.778749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ea84d-f76b-4e4f-bad7-34284a4f59ec None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:45.816019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f9b47-3a32-4488-815f-19191805cae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:45.817044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9b47-3a32-4488-815f-19191805cae0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.817573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9b47-3a32-4488-815f-19191805cae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.817915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9b47-3a32-4488-815f-19191805cae0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.826417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:45.826907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f9b47-3a32-4488-815f-19191805cae0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:45.828405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f9b47-3a32-4488-815f-19191805cae0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-7d8f9b47-3a32-4488-815f-19191805cae0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:45.845545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:45.846657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:45.847607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 247/500] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:45.848190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f9b47-3a32-4488-815f-19191805cae0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:45.858601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96daeb-ce5f-4876-9b2a-c28a8170e46a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:45.895534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc64f83-64e3-4fb0-8a12-7a8c36f0f02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:45.896207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc64f83-64e3-4fb0-8a12-7a8c36f0f02a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.896532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc64f83-64e3-4fb0-8a12-7a8c36f0f02a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.896861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc64f83-64e3-4fb0-8a12-7a8c36f0f02a None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:45.897612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc64f83-64e3-4fb0-8a12-7a8c36f0f02a None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:45.897922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc64f83-64e3-4fb0-8a12-7a8c36f0f02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:45.899327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc64f83-64e3-4fb0-8a12-7a8c36f0f02a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:45.907978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 254/501] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:45.908716 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc64f83-64e3-4fb0-8a12-7a8c36f0f02a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:45.922278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:45.953877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f9b47-3a32-4488-815f-19191805cae0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:45.988383 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cd7a4-3392-43ae-9888-4ea8ee87d992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:45.989185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cd7a4-3392-43ae-9888-4ea8ee87d992 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:45.989506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cd7a4-3392-43ae-9888-4ea8ee87d992 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:45.989827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cd7a4-3392-43ae-9888-4ea8ee87d992 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.000702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cd7a4-3392-43ae-9888-4ea8ee87d992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:46.007548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc64f83-64e3-4fb0-8a12-7a8c36f0f02a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-072cd7a4-3392-43ae-9888-4ea8ee87d992 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:46.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:46.009354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 248/502] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:46.010500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cd7a4-3392-43ae-9888-4ea8ee87d992 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:46.046257 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c4f72-b8c6-4a55-907d-c346bdbe699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:46.046931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4f72-b8c6-4a55-907d-c346bdbe699d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.047242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4f72-b8c6-4a55-907d-c346bdbe699d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.047522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4f72-b8c6-4a55-907d-c346bdbe699d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.051248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:46.109712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cd7a4-3392-43ae-9888-4ea8ee87d992 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:46.115712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c4f72-b8c6-4a55-907d-c346bdbe699d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:46.117167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c4f72-b8c6-4a55-907d-c346bdbe699d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:46.138410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:46.144471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891ecd7-363a-4945-b7f7-9219ed64c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:46.145135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ecd7-363a-4945-b7f7-9219ed64c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.145423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ecd7-363a-4945-b7f7-9219ed64c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.145700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ecd7-363a-4945-b7f7-9219ed64c8e8 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.146567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891ecd7-363a-4945-b7f7-9219ed64c8e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:46.146890 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891ecd7-363a-4945-b7f7-9219ed64c8e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:46.148332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891ecd7-363a-4945-b7f7-9219ed64c8e8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:46.185844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 249/503] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Jun 24 10:19:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:46.186824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e24e2b-6ec1-4e3f-8767-f817e8a53363 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.187121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e24e2b-6ec1-4e3f-8767-f817e8a53363 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.187403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e24e2b-6ec1-4e3f-8767-f817e8a53363 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.190430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 250/504] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:46.190430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e24e2b-6ec1-4e3f-8767-f817e8a53363 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:46.216034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 255/505] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:46.216876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c4f72-b8c6-4a55-907d-c346bdbe699d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:46.251260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:46.291753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e24e2b-6ec1-4e3f-8767-f817e8a53363 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:46.317216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c4f72-b8c6-4a55-907d-c346bdbe699d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:46.326094 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432389c5-50a1-46ef-b5a4-fd200fec19bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:46.326906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432389c5-50a1-46ef-b5a4-fd200fec19bb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.327196 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432389c5-50a1-46ef-b5a4-fd200fec19bb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.327480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432389c5-50a1-46ef-b5a4-fd200fec19bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.337288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432389c5-50a1-46ef-b5a4-fd200fec19bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:46.339326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432389c5-50a1-46ef-b5a4-fd200fec19bb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:46.350393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ffc1e-3d9a-4aa7-8fe0-df7196526876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:46.351061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ffc1e-3d9a-4aa7-8fe0-df7196526876 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.351344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ffc1e-3d9a-4aa7-8fe0-df7196526876 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.351619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ffc1e-3d9a-4aa7-8fe0-df7196526876 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.352359 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ffc1e-3d9a-4aa7-8fe0-df7196526876 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:46.352668 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ffc1e-3d9a-4aa7-8fe0-df7196526876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:46.354030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ffc1e-3d9a-4aa7-8fe0-df7196526876 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-432389c5-50a1-46ef-b5a4-fd200fec19bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:46.356988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:46.357897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:46.358947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:46.358947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:46.358947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:46.358947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:46.358947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 251/506] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:46.359216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432389c5-50a1-46ef-b5a4-fd200fec19bb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:46.362853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 256/507] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:46.364089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ded6-fb63-42b7-b23d-d89ade4b9e50 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.364383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ded6-fb63-42b7-b23d-d89ade4b9e50 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.364663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851ded6-fb63-42b7-b23d-d89ade4b9e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.380239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3851ded6-fb63-42b7-b23d-d89ade4b9e50 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:46.381489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3851ded6-fb63-42b7-b23d-d89ade4b9e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:46.407569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:46.448139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 257/508] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:46.448925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851ded6-fb63-42b7-b23d-d89ade4b9e50 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:46.474055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432389c5-50a1-46ef-b5a4-fd200fec19bb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:46.477517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:46.507857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e12f5-ac4c-4b74-a6e9-a59b252c3d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:46.508501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e12f5-ac4c-4b74-a6e9-a59b252c3d54 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.508791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e12f5-ac4c-4b74-a6e9-a59b252c3d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.509069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e12f5-ac4c-4b74-a6e9-a59b252c3d54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.549254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851ded6-fb63-42b7-b23d-d89ade4b9e50 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:46.576557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e12f5-ac4c-4b74-a6e9-a59b252c3d54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:46.578030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e12f5-ac4c-4b74-a6e9-a59b252c3d54 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:46.585341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f52bdd-0ddc-4c78-b50b-f5f39526f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:46.586136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f52bdd-0ddc-4c78-b50b-f5f39526f9db None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.586457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f52bdd-0ddc-4c78-b50b-f5f39526f9db None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.586743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f52bdd-0ddc-4c78-b50b-f5f39526f9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.597341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f52bdd-0ddc-4c78-b50b-f5f39526f9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:46.598812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f52bdd-0ddc-4c78-b50b-f5f39526f9db None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-23f52bdd-0ddc-4c78-b50b-f5f39526f9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:46.615921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:46.616925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:46.617975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:46.617975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:46.617975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:46.617975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:46.617975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 258/509] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:46.618480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f52bdd-0ddc-4c78-b50b-f5f39526f9db None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:46.618803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:46.680402 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 252/510] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:46.681277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e12f5-ac4c-4b74-a6e9-a59b252c3d54 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:46.700286 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:46.720330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f52bdd-0ddc-4c78-b50b-f5f39526f9db None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:46.753717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215537a-6f3d-4741-a1b6-e4f77b1a375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:46.754505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215537a-6f3d-4741-a1b6-e4f77b1a375e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.754794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215537a-6f3d-4741-a1b6-e4f77b1a375e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.755146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215537a-6f3d-4741-a1b6-e4f77b1a375e None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.755878 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215537a-6f3d-4741-a1b6-e4f77b1a375e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:46.756209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215537a-6f3d-4741-a1b6-e4f77b1a375e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:46.757569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215537a-6f3d-4741-a1b6-e4f77b1a375e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:46.769888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 259/511] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:46.770739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215537a-6f3d-4741-a1b6-e4f77b1a375e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:46.783269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e12f5-ac4c-4b74-a6e9-a59b252c3d54 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:46.819335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c04e1-8d6d-44ef-b707-d13c1752e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:46.820123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c04e1-8d6d-44ef-b707-d13c1752e666 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.820411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c04e1-8d6d-44ef-b707-d13c1752e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.820687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c04e1-8d6d-44ef-b707-d13c1752e666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.829286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:46.831572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c04e1-8d6d-44ef-b707-d13c1752e666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:46.833395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c04e1-8d6d-44ef-b707-d13c1752e666 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-367c04e1-8d6d-44ef-b707-d13c1752e666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:46.852386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:46.853271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:46.854126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:46.854126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:46.854126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:46.854126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:46.854126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 253/512] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:46.854420 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c04e1-8d6d-44ef-b707-d13c1752e666 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:46.876963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215537a-6f3d-4741-a1b6-e4f77b1a375e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:46.910408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad900b-4d98-4869-81c2-b7b8b250cf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:46.911193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad900b-4d98-4869-81c2-b7b8b250cf75 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.911484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad900b-4d98-4869-81c2-b7b8b250cf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.911761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad900b-4d98-4869-81c2-b7b8b250cf75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.919828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:46.921960 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad900b-4d98-4869-81c2-b7b8b250cf75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:46.923720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad900b-4d98-4869-81c2-b7b8b250cf75 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-12ad900b-4d98-4869-81c2-b7b8b250cf75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:46.941897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:46.942804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:46.943638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:46.943638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:46.943638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:46.943638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:46.943638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 260/513] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:46.943932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad900b-4d98-4869-81c2-b7b8b250cf75 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:46.961020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c04e1-8d6d-44ef-b707-d13c1752e666 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:46.994011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f025f-9e3c-421a-b20a-612bcf4707c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:46.994700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f025f-9e3c-421a-b20a-612bcf4707c8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:46.995504 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f025f-9e3c-421a-b20a-612bcf4707c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:46.995784 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f025f-9e3c-421a-b20a-612bcf4707c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:46.996499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f025f-9e3c-421a-b20a-612bcf4707c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:46.996805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f025f-9e3c-421a-b20a-612bcf4707c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:46.998164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f025f-9e3c-421a-b20a-612bcf4707c8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.008966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 254/514] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:47.009823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f025f-9e3c-421a-b20a-612bcf4707c8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.041163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad900b-4d98-4869-81c2-b7b8b250cf75 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.066545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:47.075952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc5347-2d8f-456b-83f5-184f8b5db3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.076742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5347-2d8f-456b-83f5-184f8b5db3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.077036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5347-2d8f-456b-83f5-184f8b5db3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.077318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5347-2d8f-456b-83f5-184f8b5db3d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.087337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc5347-2d8f-456b-83f5-184f8b5db3d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.088795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc5347-2d8f-456b-83f5-184f8b5db3d7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a9dc5347-2d8f-456b-83f5-184f8b5db3d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:47.106268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:47.107136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:47.107996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:47.107996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:47.107996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:47.107996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:47.107996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 261/515] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:47.108253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc5347-2d8f-456b-83f5-184f8b5db3d7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.117592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f025f-9e3c-421a-b20a-612bcf4707c8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.152316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca95c2-4a7e-48ee-a13d-430020735ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.153101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca95c2-4a7e-48ee-a13d-430020735ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.153391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca95c2-4a7e-48ee-a13d-430020735ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.153564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:47.153669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca95c2-4a7e-48ee-a13d-430020735ac3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.161165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca95c2-4a7e-48ee-a13d-430020735ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.162631 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca95c2-4a7e-48ee-a13d-430020735ac3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-10ca95c2-4a7e-48ee-a13d-430020735ac3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:47.177378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:47.178284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:47.179239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 255/516] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:47.179794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca95c2-4a7e-48ee-a13d-430020735ac3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.209488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc5347-2d8f-456b-83f5-184f8b5db3d7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.243150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43da97f-3759-44b1-abc8-fc69e62aed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.243739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43da97f-3759-44b1-abc8-fc69e62aed82 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.244021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43da97f-3759-44b1-abc8-fc69e62aed82 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.244306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43da97f-3759-44b1-abc8-fc69e62aed82 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.245043 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43da97f-3759-44b1-abc8-fc69e62aed82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:47.245350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43da97f-3759-44b1-abc8-fc69e62aed82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.246738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43da97f-3759-44b1-abc8-fc69e62aed82 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.257597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 262/517] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:47.258397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43da97f-3759-44b1-abc8-fc69e62aed82 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.282002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca95c2-4a7e-48ee-a13d-430020735ac3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.294571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:47.315747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f01f1a-e4c1-4390-8e02-ea3d06d32809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.316403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f01f1a-e4c1-4390-8e02-ea3d06d32809 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.316687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f01f1a-e4c1-4390-8e02-ea3d06d32809 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.316973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f01f1a-e4c1-4390-8e02-ea3d06d32809 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.317689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f01f1a-e4c1-4390-8e02-ea3d06d32809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:47.317997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f01f1a-e4c1-4390-8e02-ea3d06d32809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.319399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f01f1a-e4c1-4390-8e02-ea3d06d32809 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.331431 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 256/518] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:47.332215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f01f1a-e4c1-4390-8e02-ea3d06d32809 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.357421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43da97f-3759-44b1-abc8-fc69e62aed82 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.359730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:47.391408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5e353-1473-43b4-a542-654f142a0551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.392189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5e353-1473-43b4-a542-654f142a0551 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.392474 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5e353-1473-43b4-a542-654f142a0551 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.392746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5e353-1473-43b4-a542-654f142a0551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.399313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5e353-1473-43b4-a542-654f142a0551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.400751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5e353-1473-43b4-a542-654f142a0551 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-8fa5e353-1473-43b4-a542-654f142a0551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:19:47.416324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:47.417249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:47.418111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:19:47.418111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:19:47.418111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:19:47.418111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:19:47.418111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:19:47.418111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:19:47.418111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:47.418111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:47.418111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 263/519] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:47.418625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5e353-1473-43b4-a542-654f142a0551 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.431044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f01f1a-e4c1-4390-8e02-ea3d06d32809 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.466743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dd6af-cf49-4899-a152-9b62cb945efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.467800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dd6af-cf49-4899-a152-9b62cb945efa None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.468093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dd6af-cf49-4899-a152-9b62cb945efa None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.468379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dd6af-cf49-4899-a152-9b62cb945efa None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.469100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dd6af-cf49-4899-a152-9b62cb945efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:47.469764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dd6af-cf49-4899-a152-9b62cb945efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.471507 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dd6af-cf49-4899-a152-9b62cb945efa None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.482634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 257/520] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:47.483432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dd6af-cf49-4899-a152-9b62cb945efa None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.513895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:47.529158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5e353-1473-43b4-a542-654f142a0551 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.565076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb0e74-4c66-47e8-b7c2-6f5002ea33f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.565744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0e74-4c66-47e8-b7c2-6f5002ea33f7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.566030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0e74-4c66-47e8-b7c2-6f5002ea33f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.566306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0e74-4c66-47e8-b7c2-6f5002ea33f7 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.567170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb0e74-4c66-47e8-b7c2-6f5002ea33f7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:47.567480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb0e74-4c66-47e8-b7c2-6f5002ea33f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.568921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb0e74-4c66-47e8-b7c2-6f5002ea33f7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.584368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dd6af-cf49-4899-a152-9b62cb945efa None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.586656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 264/521] 10.222.0.44 () {56 vars in 1139 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:47.587447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb0e74-4c66-47e8-b7c2-6f5002ea33f7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.611071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:47.618188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc25e5a-ef17-49af-b272-f5cb234c857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.619005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25e5a-ef17-49af-b272-f5cb234c857a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.619292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25e5a-ef17-49af-b272-f5cb234c857a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.619571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25e5a-ef17-49af-b272-f5cb234c857a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.627493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc25e5a-ef17-49af-b272-f5cb234c857a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.628939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc25e5a-ef17-49af-b272-f5cb234c857a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-7fc25e5a-ef17-49af-b272-f5cb234c857a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:47.643626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:47.644742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:47.645690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 258/522] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:47.646247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc25e5a-ef17-49af-b272-f5cb234c857a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.690793 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb0e74-4c66-47e8-b7c2-6f5002ea33f7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.724940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2defd31-2aa8-4f0d-8674-a535667fe904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.725601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2defd31-2aa8-4f0d-8674-a535667fe904 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.725889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2defd31-2aa8-4f0d-8674-a535667fe904 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.726168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2defd31-2aa8-4f0d-8674-a535667fe904 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.726909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2defd31-2aa8-4f0d-8674-a535667fe904 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.728337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2defd31-2aa8-4f0d-8674-a535667fe904 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.736120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:47.746234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc25e5a-ef17-49af-b272-f5cb234c857a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.747920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 265/523] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:19:47 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:19:47.748726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2defd31-2aa8-4f0d-8674-a535667fe904 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.786867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57876b4a-a29f-4797-a0af-a8bbb214a4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.787744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57876b4a-a29f-4797-a0af-a8bbb214a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.788168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57876b4a-a29f-4797-a0af-a8bbb214a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.788450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57876b4a-a29f-4797-a0af-a8bbb214a4f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.789258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57876b4a-a29f-4797-a0af-a8bbb214a4f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:47.789617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57876b4a-a29f-4797-a0af-a8bbb214a4f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.791426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57876b4a-a29f-4797-a0af-a8bbb214a4f0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.817670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 259/524] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:47.817670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57876b4a-a29f-4797-a0af-a8bbb214a4f0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.853769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:47.886446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2defd31-2aa8-4f0d-8674-a535667fe904 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.924917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57876b4a-a29f-4797-a0af-a8bbb214a4f0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:47.925142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86e34b-d6d0-421c-8c14-945cfde047de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.925886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86e34b-d6d0-421c-8c14-945cfde047de None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.926172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86e34b-d6d0-421c-8c14-945cfde047de None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.926470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86e34b-d6d0-421c-8c14-945cfde047de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.934891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86e34b-d6d0-421c-8c14-945cfde047de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:47.936526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86e34b-d6d0-421c-8c14-945cfde047de None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-bf86e34b-d6d0-421c-8c14-945cfde047de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:19:47.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:47.952992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:47.954098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:19:47.954098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:19:47.954098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:19:47.954098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:19:47.954098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:19:47.954098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:19:47.954098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:47.954098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:47.954098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 266/525] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:47.954710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86e34b-d6d0-421c-8c14-945cfde047de None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:47.965403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a1a10-15de-48e6-b524-71d448f57dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:47.966065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a1a10-15de-48e6-b524-71d448f57dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:47.966444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a1a10-15de-48e6-b524-71d448f57dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:47.966688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a1a10-15de-48e6-b524-71d448f57dc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:47.989901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:48.040351 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a1a10-15de-48e6-b524-71d448f57dc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:48.041712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a1a10-15de-48e6-b524-71d448f57dc3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:48.067346 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86e34b-d6d0-421c-8c14-945cfde047de None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:48.103895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0de0-f6b6-4b3b-bfc8-8f53c77e2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:48.105399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0de0-f6b6-4b3b-bfc8-8f53c77e2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:48.105947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0de0-f6b6-4b3b-bfc8-8f53c77e2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:48.106230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0de0-f6b6-4b3b-bfc8-8f53c77e2fc3 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:48.107111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0de0-f6b6-4b3b-bfc8-8f53c77e2fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:48.107407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0de0-f6b6-4b3b-bfc8-8f53c77e2fc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:48.108966 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0de0-f6b6-4b3b-bfc8-8f53c77e2fc3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:48.117408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:48.133181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 267/526] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:48.133181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0de0-f6b6-4b3b-bfc8-8f53c77e2fc3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:48.153121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 260/527] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:48.153121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a1a10-15de-48e6-b524-71d448f57dc3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:48.206740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:48.244213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0de0-f6b6-4b3b-bfc8-8f53c77e2fc3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:48.259070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a1a10-15de-48e6-b524-71d448f57dc3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:48.280651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89eb60-4863-45b5-96d7-a28b05e1d4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:48.281452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89eb60-4863-45b5-96d7-a28b05e1d4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:48.281752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89eb60-4863-45b5-96d7-a28b05e1d4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:48.282071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89eb60-4863-45b5-96d7-a28b05e1d4d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:48.282930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89eb60-4863-45b5-96d7-a28b05e1d4d7 None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=a66ff3915a784ddcb3925aadcb416700) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:48.283243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89eb60-4863-45b5-96d7-a28b05e1d4d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:48.284709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89eb60-4863-45b5-96d7-a28b05e1d4d7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:48.296797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74207dc8-a671-4f85-991c-67c2d2cc7271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:48.297397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74207dc8-a671-4f85-991c-67c2d2cc7271 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:48.297679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74207dc8-a671-4f85-991c-67c2d2cc7271 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:48.297955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74207dc8-a671-4f85-991c-67c2d2cc7271 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:48.298548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 268/528] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:48 2022] GET /identity/v3/role_assignments?user.id=a66ff3915a784ddcb3925aadcb416700&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:48.298800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74207dc8-a671-4f85-991c-67c2d2cc7271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:48.299114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74207dc8-a671-4f85-991c-67c2d2cc7271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:48.300633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89eb60-4863-45b5-96d7-a28b05e1d4d7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:48.300873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74207dc8-a671-4f85-991c-67c2d2cc7271 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:48.320666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 261/529] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:48.321667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74207dc8-a671-4f85-991c-67c2d2cc7271 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:48.389690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:48.437803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89eb60-4863-45b5-96d7-a28b05e1d4d7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:48.458510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74207dc8-a671-4f85-991c-67c2d2cc7271 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:48.472704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:48.492685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b654a98-4320-4e88-98a6-fa461a18e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:48.493935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654a98-4320-4e88-98a6-fa461a18e412 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:48.494804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654a98-4320-4e88-98a6-fa461a18e412 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:48.495540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654a98-4320-4e88-98a6-fa461a18e412 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:48.499147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b7df7-bd2d-45ee-93f5-80a0861ef118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:48.499992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7df7-bd2d-45ee-93f5-80a0861ef118 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:48.500354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7df7-bd2d-45ee-93f5-80a0861ef118 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:48.500702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b7df7-bd2d-45ee-93f5-80a0861ef118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:48.511818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b7df7-bd2d-45ee-93f5-80a0861ef118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:48.513364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b7df7-bd2d-45ee-93f5-80a0861ef118 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-f94b7df7-bd2d-45ee-93f5-80a0861ef118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:48.541453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:48.542986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:48.543830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:48.543830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:48.543830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:48.543830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:48.543830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 262/530] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:48.544618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b7df7-bd2d-45ee-93f5-80a0861ef118 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:48.584389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b654a98-4320-4e88-98a6-fa461a18e412 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:48.585971 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b654a98-4320-4e88-98a6-fa461a18e412 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:48.649459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:48.660212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b7df7-bd2d-45ee-93f5-80a0861ef118 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:48.694552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28695cd0-8873-45da-be3b-df2333f4fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:48.695262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28695cd0-8873-45da-be3b-df2333f4fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:48.695546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28695cd0-8873-45da-be3b-df2333f4fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:48.695864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28695cd0-8873-45da-be3b-df2333f4fdf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:48.696697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28695cd0-8873-45da-be3b-df2333f4fdf3 None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=2fe27c3402a741f0a80d87ae6ecd3f3d) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:48.697189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28695cd0-8873-45da-be3b-df2333f4fdf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:48.698690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28695cd0-8873-45da-be3b-df2333f4fdf3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:48.699823 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 269/531] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:48.701115 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b654a98-4320-4e88-98a6-fa461a18e412 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:48.710314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 263/532] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:48 2022] GET /identity/v3/role_assignments?user.id=2fe27c3402a741f0a80d87ae6ecd3f3d&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:48.711038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28695cd0-8873-45da-be3b-df2333f4fdf3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:48.745423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:48.828728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b654a98-4320-4e88-98a6-fa461a18e412 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:48.874673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331ef65-fc55-4345-8255-07513f1f6602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:48.875638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331ef65-fc55-4345-8255-07513f1f6602 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:48.876218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331ef65-fc55-4345-8255-07513f1f6602 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:48.876697 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331ef65-fc55-4345-8255-07513f1f6602 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:48.877616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331ef65-fc55-4345-8255-07513f1f6602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:48.878117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331ef65-fc55-4345-8255-07513f1f6602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:48.879851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331ef65-fc55-4345-8255-07513f1f6602 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:48.893740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 270/533] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:48.897443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28695cd0-8873-45da-be3b-df2333f4fdf3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:48.898894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331ef65-fc55-4345-8255-07513f1f6602 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:48.923883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:48.973786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a9013-e018-4b93-8faa-58d1cbc546c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:48.974673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a9013-e018-4b93-8faa-58d1cbc546c2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:48.974954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a9013-e018-4b93-8faa-58d1cbc546c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:48.975224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a9013-e018-4b93-8faa-58d1cbc546c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:48.993198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a9013-e018-4b93-8faa-58d1cbc546c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:48.994719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a9013-e018-4b93-8faa-58d1cbc546c2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-525a9013-e018-4b93-8faa-58d1cbc546c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:49.016393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:49.017317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:49.018173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:49.018173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:49.018173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:49.018173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:49.018173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 264/534] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:49.023531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a9013-e018-4b93-8faa-58d1cbc546c2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:49.034035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331ef65-fc55-4345-8255-07513f1f6602 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:49.107200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002994e-340f-4bc1-84db-4c13d4345f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:49.108038 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002994e-340f-4bc1-84db-4c13d4345f1d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:49.108323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002994e-340f-4bc1-84db-4c13d4345f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:49.108596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002994e-340f-4bc1-84db-4c13d4345f1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:49.117470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002994e-340f-4bc1-84db-4c13d4345f1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:49.121559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002994e-340f-4bc1-84db-4c13d4345f1d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d002994e-340f-4bc1-84db-4c13d4345f1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:19:49.143077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:49.143929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:49.144787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:19:49.144787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:19:49.144787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:19:49.144787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:19:49.144787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:19:49.144787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:19:49.144787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:49.144787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:49.144787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 271/535] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:49.154655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002994e-340f-4bc1-84db-4c13d4345f1d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:49.190722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:49.224212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a9013-e018-4b93-8faa-58d1cbc546c2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:49.233796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:49.255566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002994e-340f-4bc1-84db-4c13d4345f1d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:49.292344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87837d-4722-4de7-a19d-e51972eb45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:49.293062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87837d-4722-4de7-a19d-e51972eb45f6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:49.293345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87837d-4722-4de7-a19d-e51972eb45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:49.293623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87837d-4722-4de7-a19d-e51972eb45f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:49.294565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87837d-4722-4de7-a19d-e51972eb45f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:49.295102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87837d-4722-4de7-a19d-e51972eb45f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:49.296585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87837d-4722-4de7-a19d-e51972eb45f6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:49.311623 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a676-01a3-43e3-be0d-c8b78c51ff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:49.312306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a676-01a3-43e3-be0d-c8b78c51ff29 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:49.312591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a676-01a3-43e3-be0d-c8b78c51ff29 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:49.312868 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a676-01a3-43e3-be0d-c8b78c51ff29 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:49.313608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27a676-01a3-43e3-be0d-c8b78c51ff29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:49.313914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27a676-01a3-43e3-be0d-c8b78c51ff29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:49.315333 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27a676-01a3-43e3-be0d-c8b78c51ff29 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:49.317324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 272/536] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:49.323641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87837d-4722-4de7-a19d-e51972eb45f6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:49.341139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 265/537] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:49.346330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a676-01a3-43e3-be0d-c8b78c51ff29 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:49.428141 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87837d-4722-4de7-a19d-e51972eb45f6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:49.464688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763e3fe-a4c9-4e0e-89e4-3dc431ad8b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:49.465342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763e3fe-a4c9-4e0e-89e4-3dc431ad8b42 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:49.465625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763e3fe-a4c9-4e0e-89e4-3dc431ad8b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:49.465901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763e3fe-a4c9-4e0e-89e4-3dc431ad8b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:49.466754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763e3fe-a4c9-4e0e-89e4-3dc431ad8b42 None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=4160318c1b9b49539c6a2d8110289463) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:49.467066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763e3fe-a4c9-4e0e-89e4-3dc431ad8b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:49.468501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763e3fe-a4c9-4e0e-89e4-3dc431ad8b42 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:49.478779 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 273/538] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:49 2022] GET /identity/v3/role_assignments?user.id=4160318c1b9b49539c6a2d8110289463&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:49.591402 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a676-01a3-43e3-be0d-c8b78c51ff29 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:49.649859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d93e1e-d457-45f0-8db9-327d0b957790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:49.650706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93e1e-d457-45f0-8db9-327d0b957790 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:49.650986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93e1e-d457-45f0-8db9-327d0b957790 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:49.651294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93e1e-d457-45f0-8db9-327d0b957790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:49.659908 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d93e1e-d457-45f0-8db9-327d0b957790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:49.661374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d93e1e-d457-45f0-8db9-327d0b957790 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-48d93e1e-d457-45f0-8db9-327d0b957790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:19:49.678310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:49.679220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:49.680287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:19:49.680287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:19:49.680287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:19:49.680287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:19:49.680287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:19:49.680287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:19:49.680287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:49.680287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:49.680287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 266/539] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:49.681157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:49.685178 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763e3fe-a4c9-4e0e-89e4-3dc431ad8b42 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:49.689715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:49.791457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763e3fe-a4c9-4e0e-89e4-3dc431ad8b42 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:49.843663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8911fe-62a1-462e-8922-dc322a2925b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:49.844325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8911fe-62a1-462e-8922-dc322a2925b8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:49.844615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8911fe-62a1-462e-8922-dc322a2925b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:49.844895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8911fe-62a1-462e-8922-dc322a2925b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:49.845677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8911fe-62a1-462e-8922-dc322a2925b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:49.845987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8911fe-62a1-462e-8922-dc322a2925b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:49.847461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8911fe-62a1-462e-8922-dc322a2925b8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:49.865799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 274/540] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:49.871723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d93e1e-d457-45f0-8db9-327d0b957790 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:49.995168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d93e1e-d457-45f0-8db9-327d0b957790 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:50.048840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042e337-445a-4fcf-91f3-de718f26b004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:50.049765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e337-445a-4fcf-91f3-de718f26b004 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:50.050046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e337-445a-4fcf-91f3-de718f26b004 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:50.050317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e337-445a-4fcf-91f3-de718f26b004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:50.051234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042e337-445a-4fcf-91f3-de718f26b004 None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=a9cffe87117f447dacec4289f454a8ec) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:50.051546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042e337-445a-4fcf-91f3-de718f26b004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:50.052998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042e337-445a-4fcf-91f3-de718f26b004 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:50.059407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 267/541] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:49 2022] GET /identity/v3/role_assignments?user.id=a9cffe87117f447dacec4289f454a8ec&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:50.224053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc56565-6410-466e-a8b3-4262a56fc530 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:50.224705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc56565-6410-466e-a8b3-4262a56fc530 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:50.224705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc56565-6410-466e-a8b3-4262a56fc530 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:50.226231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 275/542] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:50.232297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef18b3a-29f0-404c-a6a6-136eb1e4f9ac None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:50.232596 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef18b3a-29f0-404c-a6a6-136eb1e4f9ac None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:50.232880 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef18b3a-29f0-404c-a6a6-136eb1e4f9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:50.250648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-cef18b3a-29f0-404c-a6a6-136eb1e4f9ac None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:50.251785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cef18b3a-29f0-404c-a6a6-136eb1e4f9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:50.328413 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:50.342690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 268/543] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:50.386850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc56565-6410-466e-a8b3-4262a56fc530 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:50.477881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:50.520465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc56565-6410-466e-a8b3-4262a56fc530 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:50.580678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4ba61-c41d-4bc4-9a5a-2e00411d6579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:50.581742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ba61-c41d-4bc4-9a5a-2e00411d6579 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:50.582256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ba61-c41d-4bc4-9a5a-2e00411d6579 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:50.582752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ba61-c41d-4bc4-9a5a-2e00411d6579 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:50.599549 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4ba61-c41d-4bc4-9a5a-2e00411d6579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-dab4ba61-c41d-4bc4-9a5a-2e00411d6579 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:50.608146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:50.609032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:50.609847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:50.612547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 276/544] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:50.618537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef18b3a-29f0-404c-a6a6-136eb1e4f9ac None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:50.673991 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d187-2506-4d7f-b71c-f8724c8603d7 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:50.674904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d187-2506-4d7f-b71c-f8724c8603d7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:50.675383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d187-2506-4d7f-b71c-f8724c8603d7 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:50.677048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 277/545] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:19:50.683724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eafb3a-5d13-42e0-9e5d-22fa5cd9a282 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:50.684009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eafb3a-5d13-42e0-9e5d-22fa5cd9a282 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:50.684284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eafb3a-5d13-42e0-9e5d-22fa5cd9a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:50.714408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-22eafb3a-5d13-42e0-9e5d-22fa5cd9a282 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:50.717319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-22eafb3a-5d13-42e0-9e5d-22fa5cd9a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:50.788114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef18b3a-29f0-404c-a6a6-136eb1e4f9ac None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:50.826538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636f86-6986-4697-bd3b-591d864ff4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:50.827354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636f86-6986-4697-bd3b-591d864ff4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:50.827642 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636f86-6986-4697-bd3b-591d864ff4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:50.827906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636f86-6986-4697-bd3b-591d864ff4e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:50.828661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636f86-6986-4697-bd3b-591d864ff4e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:50.828963 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636f86-6986-4697-bd3b-591d864ff4e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:50.830340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636f86-6986-4697-bd3b-591d864ff4e3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:50.840783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 269/546] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:50.848766 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636f86-6986-4697-bd3b-591d864ff4e3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:50.881698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 278/547] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:50.926693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eafb3a-5d13-42e0-9e5d-22fa5cd9a282 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:50.930764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:50.995544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636f86-6986-4697-bd3b-591d864ff4e3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:51.028460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:51.051056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10037ec-7d83-4e8e-bece-c0e502b99586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:51.052035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10037ec-7d83-4e8e-bece-c0e502b99586 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.052463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10037ec-7d83-4e8e-bece-c0e502b99586 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.052880 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10037ec-7d83-4e8e-bece-c0e502b99586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.072045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10037ec-7d83-4e8e-bece-c0e502b99586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:51.074240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10037ec-7d83-4e8e-bece-c0e502b99586 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a10037ec-7d83-4e8e-bece-c0e502b99586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:51.102145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:51.103216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:51.104286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:51.104286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:51.104286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:51.104286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:51.111299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eafb3a-5d13-42e0-9e5d-22fa5cd9a282 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:51.123118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 270/548] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:51.124671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10037ec-7d83-4e8e-bece-c0e502b99586 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:51.177146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e148065-1eb0-4cd8-927d-af29472a69c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:51.178246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148065-1eb0-4cd8-927d-af29472a69c6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.178690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148065-1eb0-4cd8-927d-af29472a69c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.179286 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148065-1eb0-4cd8-927d-af29472a69c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.201535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e148065-1eb0-4cd8-927d-af29472a69c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-9e148065-1eb0-4cd8-927d-af29472a69c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:51.210219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:51.211396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:51.212888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:51.223069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 279/549] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:51.228109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e148065-1eb0-4cd8-927d-af29472a69c6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:51.291242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10037ec-7d83-4e8e-bece-c0e502b99586 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:51.310760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:51.341912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8955-35bd-472a-8671-b7240d6394d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:51.342886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8955-35bd-472a-8671-b7240d6394d8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.343313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8955-35bd-472a-8671-b7240d6394d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.344267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8955-35bd-472a-8671-b7240d6394d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.345417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd8955-35bd-472a-8671-b7240d6394d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:51.345874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd8955-35bd-472a-8671-b7240d6394d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:51.348108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd8955-35bd-472a-8671-b7240d6394d8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:51.357072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e148065-1eb0-4cd8-927d-af29472a69c6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:51.372438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 271/550] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:51.372438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc1e1-23cb-49fd-9774-a20f2436660c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.372438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc1e1-23cb-49fd-9774-a20f2436660c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.372775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cc1e1-23cb-49fd-9774-a20f2436660c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.373975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 272/551] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:51.378576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cc1e1-23cb-49fd-9774-a20f2436660c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:51.379987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:51.409295 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9fe46-b6c5-4dbd-96d9-d20b3629bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:51.410671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fe46-b6c5-4dbd-96d9-d20b3629bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.411596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fe46-b6c5-4dbd-96d9-d20b3629bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.412335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fe46-b6c5-4dbd-96d9-d20b3629bbf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.413595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9fe46-b6c5-4dbd-96d9-d20b3629bbf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:51.414523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9fe46-b6c5-4dbd-96d9-d20b3629bbf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:51.416401 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9fe46-b6c5-4dbd-96d9-d20b3629bbf2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:51.428499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 280/552] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:51.430142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bf006-02d3-4160-9371-7d5191179517 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.430667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bf006-02d3-4160-9371-7d5191179517 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.431145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bf006-02d3-4160-9371-7d5191179517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.452320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-cc0bf006-02d3-4160-9371-7d5191179517 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:51.454316 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cc0bf006-02d3-4160-9371-7d5191179517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:51.497738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cc1e1-23cb-49fd-9774-a20f2436660c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:51.533012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 281/553] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:51.534239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bf006-02d3-4160-9371-7d5191179517 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:51.543213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e14b5b-c28a-4ae9-a7a7-c77086aa035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:51.544002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e14b5b-c28a-4ae9-a7a7-c77086aa035d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.544288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e14b5b-c28a-4ae9-a7a7-c77086aa035d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.544559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e14b5b-c28a-4ae9-a7a7-c77086aa035d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.562692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e14b5b-c28a-4ae9-a7a7-c77086aa035d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:51.564384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e14b5b-c28a-4ae9-a7a7-c77086aa035d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-90e14b5b-c28a-4ae9-a7a7-c77086aa035d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:51.585705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:51.586769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:51.587697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:51.587697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:51.587697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:51.587697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:51.587697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:51.587697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:51.587697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:51.587697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:51.587697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:19:51.587697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:51.592290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 273/554] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:19:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:51.593141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e14b5b-c28a-4ae9-a7a7-c77086aa035d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:51.623751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:51.649782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bf006-02d3-4160-9371-7d5191179517 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:51.658918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:51.689349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b663d-5c7d-466f-8592-46f2bf86a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:51.690535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b663d-5c7d-466f-8592-46f2bf86a349 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.691032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b663d-5c7d-466f-8592-46f2bf86a349 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.691552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b663d-5c7d-466f-8592-46f2bf86a349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.703044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b663d-5c7d-466f-8592-46f2bf86a349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:51.704678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e14b5b-c28a-4ae9-a7a7-c77086aa035d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:51.705032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b663d-5c7d-466f-8592-46f2bf86a349 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-256b663d-5c7d-466f-8592-46f2bf86a349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:51.724505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:51.725428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:51.726413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:51.726413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:51.726413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:51.726413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:51.730212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 282/555] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:51.731331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b663d-5c7d-466f-8592-46f2bf86a349 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:51.746716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad10ac9-2927-4e6e-837d-092424502fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:51.747613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad10ac9-2927-4e6e-837d-092424502fcb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.747904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad10ac9-2927-4e6e-837d-092424502fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.748183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad10ac9-2927-4e6e-837d-092424502fcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.759816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad10ac9-2927-4e6e-837d-092424502fcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-fad10ac9-2927-4e6e-837d-092424502fcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:51.768687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:51.769607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:51.770461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:51.775226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 274/556] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:51.775869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad10ac9-2927-4e6e-837d-092424502fcb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:51.846531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b663d-5c7d-466f-8592-46f2bf86a349 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:51.872449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:51.884593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae23d33-693d-43ad-8845-2b7a89b82fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:51.886117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae23d33-693d-43ad-8845-2b7a89b82fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.886646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae23d33-693d-43ad-8845-2b7a89b82fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.887138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae23d33-693d-43ad-8845-2b7a89b82fd5 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.887665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad10ac9-2927-4e6e-837d-092424502fcb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:51.888443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae23d33-693d-43ad-8845-2b7a89b82fd5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:51.888963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae23d33-693d-43ad-8845-2b7a89b82fd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:51.890663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae23d33-693d-43ad-8845-2b7a89b82fd5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:51.909583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 283/557] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Jun 24 10:19:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:51.910806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae23d33-693d-43ad-8845-2b7a89b82fd5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:51.929815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffdef9-e91b-4951-a4e9-c60c8146fca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:51.929996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:51.930964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffdef9-e91b-4951-a4e9-c60c8146fca4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.931480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffdef9-e91b-4951-a4e9-c60c8146fca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.931826 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffdef9-e91b-4951-a4e9-c60c8146fca4 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.932527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffdef9-e91b-4951-a4e9-c60c8146fca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:51.932841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffdef9-e91b-4951-a4e9-c60c8146fca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:51.934214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffdef9-e91b-4951-a4e9-c60c8146fca4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:51.946263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 275/558] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:51.947621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c94ac0-2cf4-4188-9fd0-21d225456adc None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:51.948449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c94ac0-2cf4-4188-9fd0-21d225456adc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:51.948729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c94ac0-2cf4-4188-9fd0-21d225456adc None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:51.950146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 276/559] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:51.950839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c94ac0-2cf4-4188-9fd0-21d225456adc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:52.021451 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae23d33-693d-43ad-8845-2b7a89b82fd5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.056060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c94ac0-2cf4-4188-9fd0-21d225456adc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.057824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f96f1-fa47-4f91-9bf7-86a3332f9d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:52.058905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f96f1-fa47-4f91-9bf7-86a3332f9d4e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.059291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f96f1-fa47-4f91-9bf7-86a3332f9d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.059575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f96f1-fa47-4f91-9bf7-86a3332f9d4e None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.060328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f96f1-fa47-4f91-9bf7-86a3332f9d4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:52.060636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f96f1-fa47-4f91-9bf7-86a3332f9d4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:52.062008 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f96f1-fa47-4f91-9bf7-86a3332f9d4e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:52.076290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 284/560] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:52.076290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bd0ed-62c1-4717-aa0d-2105f0969e15 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.076290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bd0ed-62c1-4717-aa0d-2105f0969e15 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.076290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bd0ed-62c1-4717-aa0d-2105f0969e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.098146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c13bd0ed-62c1-4717-aa0d-2105f0969e15 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:52.099306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c13bd0ed-62c1-4717-aa0d-2105f0969e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:52.100941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432e78f-ffbb-4d03-bdbd-d81f75278d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:52.101600 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432e78f-ffbb-4d03-bdbd-d81f75278d43 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.101891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432e78f-ffbb-4d03-bdbd-d81f75278d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.102177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432e78f-ffbb-4d03-bdbd-d81f75278d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.120787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:52.171584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 285/561] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:52.172870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bd0ed-62c1-4717-aa0d-2105f0969e15 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:52.179273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432e78f-ffbb-4d03-bdbd-d81f75278d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:52.180749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432e78f-ffbb-4d03-bdbd-d81f75278d43 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:52.191242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:52.285932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bd0ed-62c1-4717-aa0d-2105f0969e15 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.292322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 277/562] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:52.292322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432e78f-ffbb-4d03-bdbd-d81f75278d43 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:52.326257 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aa260-405b-4cc6-bb04-4dabc61abbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:52.327071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aa260-405b-4cc6-bb04-4dabc61abbbc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.327350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aa260-405b-4cc6-bb04-4dabc61abbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.327620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aa260-405b-4cc6-bb04-4dabc61abbbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.334828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aa260-405b-4cc6-bb04-4dabc61abbbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:52.336260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aa260-405b-4cc6-bb04-4dabc61abbbc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:52.340746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-681aa260-405b-4cc6-bb04-4dabc61abbbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:52.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:52.352949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 286/563] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Jun 24 10:19:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:52.354009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aa260-405b-4cc6-bb04-4dabc61abbbc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:52.395406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432e78f-ffbb-4d03-bdbd-d81f75278d43 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.418981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:52.430630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f1b77-2cda-4437-9fbc-74ac3ee7219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:52.431735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f1b77-2cda-4437-9fbc-74ac3ee7219e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.432024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f1b77-2cda-4437-9fbc-74ac3ee7219e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.432801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f1b77-2cda-4437-9fbc-74ac3ee7219e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.443209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f1b77-2cda-4437-9fbc-74ac3ee7219e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:52.444671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f1b77-2cda-4437-9fbc-74ac3ee7219e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:52.452570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aa260-405b-4cc6-bb04-4dabc61abbbc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-7c4f1b77-2cda-4437-9fbc-74ac3ee7219e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:52.462392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:52.463304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:52.464191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:52.464191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:52.464191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:52.464191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:52.464191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 278/564] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:52.464470 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f1b77-2cda-4437-9fbc-74ac3ee7219e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:52.489503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dae0f-aef4-4ef0-ab53-3b1216e6f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:52.490292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dae0f-aef4-4ef0-ab53-3b1216e6f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.490608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dae0f-aef4-4ef0-ab53-3b1216e6f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.490889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dae0f-aef4-4ef0-ab53-3b1216e6f0f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.501714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dae0f-aef4-4ef0-ab53-3b1216e6f0f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-ee8dae0f-aef4-4ef0-ab53-3b1216e6f0f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:52.509417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:52.510332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 287/565] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:52.516231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a621d-5f34-4afa-8c7a-18b395efb0d2 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.517020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a621d-5f34-4afa-8c7a-18b395efb0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.517020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a621d-5f34-4afa-8c7a-18b395efb0d2 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.517020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 288/566] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:52.517020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a621d-5f34-4afa-8c7a-18b395efb0d2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:52.560528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:52.564485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f1b77-2cda-4437-9fbc-74ac3ee7219e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.598700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08657c8-9619-4ac2-91d0-5c886d68cbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:52.599474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08657c8-9619-4ac2-91d0-5c886d68cbab None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.599752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08657c8-9619-4ac2-91d0-5c886d68cbab None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.600029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08657c8-9619-4ac2-91d0-5c886d68cbab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.609846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08657c8-9619-4ac2-91d0-5c886d68cbab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:52.611273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08657c8-9619-4ac2-91d0-5c886d68cbab None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:52.619255 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a621d-5f34-4afa-8c7a-18b395efb0d2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c08657c8-9619-4ac2-91d0-5c886d68cbab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:52.630201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:52.631288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:52.632229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:52.632229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:52.632229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:52.632229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:52.632229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 279/567] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:52.632229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08657c8-9619-4ac2-91d0-5c886d68cbab None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:52.650253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:52.659454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa481d2-ec7b-4a3a-9b56-8fe26706710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:52.660161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa481d2-ec7b-4a3a-9b56-8fe26706710a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.660468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa481d2-ec7b-4a3a-9b56-8fe26706710a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.660749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa481d2-ec7b-4a3a-9b56-8fe26706710a None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.661584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa481d2-ec7b-4a3a-9b56-8fe26706710a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:52.661897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa481d2-ec7b-4a3a-9b56-8fe26706710a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:52.663368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa481d2-ec7b-4a3a-9b56-8fe26706710a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:52.680558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 289/568] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Jun 24 10:19:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:52.681365 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa481d2-ec7b-4a3a-9b56-8fe26706710a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:52.732839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08657c8-9619-4ac2-91d0-5c886d68cbab None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.766850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92bcaf-6731-4522-a81d-bdf42775860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:52.767730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92bcaf-6731-4522-a81d-bdf42775860f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.768012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92bcaf-6731-4522-a81d-bdf42775860f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.768288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92bcaf-6731-4522-a81d-bdf42775860f None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.769006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92bcaf-6731-4522-a81d-bdf42775860f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:52.769314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92bcaf-6731-4522-a81d-bdf42775860f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:52.770713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92bcaf-6731-4522-a81d-bdf42775860f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:52.782217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 280/569] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:52.782339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa481d2-ec7b-4a3a-9b56-8fe26706710a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.783268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ee93-8cb3-40bb-ae9e-4439377399f6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.783565 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ee93-8cb3-40bb-ae9e-4439377399f6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.783842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ee93-8cb3-40bb-ae9e-4439377399f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.805314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9ac2ee93-8cb3-40bb-ae9e-4439377399f6 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:52.806542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9ac2ee93-8cb3-40bb-ae9e-4439377399f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:52.814165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:52.822298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa3c5f-8d6c-43c8-a279-0702914e808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:52.823526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa3c5f-8d6c-43c8-a279-0702914e808e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.823803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa3c5f-8d6c-43c8-a279-0702914e808e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.824075 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa3c5f-8d6c-43c8-a279-0702914e808e None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.824818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa3c5f-8d6c-43c8-a279-0702914e808e None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:52.825123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa3c5f-8d6c-43c8-a279-0702914e808e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:52.826507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa3c5f-8d6c-43c8-a279-0702914e808e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:52.834520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 290/570] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:52.835301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa3c5f-8d6c-43c8-a279-0702914e808e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:52.876460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 281/571] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:52.877658 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2ee93-8cb3-40bb-ae9e-4439377399f6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:52.891452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:52.942854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa3c5f-8d6c-43c8-a279-0702914e808e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.975885 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac79ddd-1920-4048-9ff7-ac0e049976f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:52.976412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2ee93-8cb3-40bb-ae9e-4439377399f6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:52.976542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac79ddd-1920-4048-9ff7-ac0e049976f9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:52.976825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac79ddd-1920-4048-9ff7-ac0e049976f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:52.977100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac79ddd-1920-4048-9ff7-ac0e049976f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:52.977809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac79ddd-1920-4048-9ff7-ac0e049976f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:52.978112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac79ddd-1920-4048-9ff7-ac0e049976f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:52.979529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac79ddd-1920-4048-9ff7-ac0e049976f9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:52.991055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 291/572] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:52.991729 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac79ddd-1920-4048-9ff7-ac0e049976f9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.009521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71730541-040a-4135-8190-babb22e550f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.010892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71730541-040a-4135-8190-babb22e550f6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.011177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71730541-040a-4135-8190-babb22e550f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.011456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71730541-040a-4135-8190-babb22e550f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.021349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71730541-040a-4135-8190-babb22e550f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.022962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71730541-040a-4135-8190-babb22e550f6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.024685 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-71730541-040a-4135-8190-babb22e550f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:53.040570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:53.041622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:53.042545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:53.042545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:53.042545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:53.042545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:53.042545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 282/573] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:53.042831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71730541-040a-4135-8190-babb22e550f6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.096205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac79ddd-1920-4048-9ff7-ac0e049976f9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.105022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:53.130250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997eb9b-f9a0-4218-a5b4-216d3da34970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.130996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997eb9b-f9a0-4218-a5b4-216d3da34970 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.131274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997eb9b-f9a0-4218-a5b4-216d3da34970 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.131544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997eb9b-f9a0-4218-a5b4-216d3da34970 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.138978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997eb9b-f9a0-4218-a5b4-216d3da34970 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.140386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997eb9b-f9a0-4218-a5b4-216d3da34970 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.141589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71730541-040a-4135-8190-babb22e550f6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-8997eb9b-f9a0-4218-a5b4-216d3da34970 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:53.154534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:53.155464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:53.156391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 292/574] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:53.156970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997eb9b-f9a0-4218-a5b4-216d3da34970 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.179478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf853e-9585-4164-9d3a-5f69bf374233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.180264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf853e-9585-4164-9d3a-5f69bf374233 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.180550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf853e-9585-4164-9d3a-5f69bf374233 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.180822 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf853e-9585-4164-9d3a-5f69bf374233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.190954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf853e-9585-4164-9d3a-5f69bf374233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.192380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf853e-9585-4164-9d3a-5f69bf374233 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d8cf853e-9585-4164-9d3a-5f69bf374233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:53.209943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:53.210853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:53.216446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:53.216446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:53.216446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:53.216446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:53.216446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 283/575] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:53.216446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf853e-9585-4164-9d3a-5f69bf374233 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.253981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997eb9b-f9a0-4218-a5b4-216d3da34970 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.257540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:53.289341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e3147-460b-4127-bab4-07e7216fef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.290136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3147-460b-4127-bab4-07e7216fef2f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.290453 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3147-460b-4127-bab4-07e7216fef2f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.290733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3147-460b-4127-bab4-07e7216fef2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.301628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e3147-460b-4127-bab4-07e7216fef2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b18e3147-460b-4127-bab4-07e7216fef2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:53.309875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:53.311010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:53.316905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:53.317680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf853e-9585-4164-9d3a-5f69bf374233 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.317765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 293/576] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:53.317765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e3147-460b-4127-bab4-07e7216fef2f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.339180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:53.352156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ec184-3cfb-4aa4-af2f-0b2dcf975fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.353301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ec184-3cfb-4aa4-af2f-0b2dcf975fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.353592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ec184-3cfb-4aa4-af2f-0b2dcf975fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.354499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ec184-3cfb-4aa4-af2f-0b2dcf975fb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.361206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ec184-3cfb-4aa4-af2f-0b2dcf975fb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.362671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ec184-3cfb-4aa4-af2f-0b2dcf975fb5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-287ec184-3cfb-4aa4-af2f-0b2dcf975fb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:19:53.377129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:53.377982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:53.378898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:19:53.378898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:19:53.378898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:19:53.378898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:19:53.378898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:19:53.378898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:19:53.378898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:53.378898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:53.378898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 284/577] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:53.379376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ec184-3cfb-4aa4-af2f-0b2dcf975fb5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.412960 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e3147-460b-4127-bab4-07e7216fef2f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.445949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914cf6e-1573-418e-8cdc-a6326f97a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.446630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914cf6e-1573-418e-8cdc-a6326f97a50e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.446916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914cf6e-1573-418e-8cdc-a6326f97a50e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.447192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914cf6e-1573-418e-8cdc-a6326f97a50e None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.447938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914cf6e-1573-418e-8cdc-a6326f97a50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:53.448239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914cf6e-1573-418e-8cdc-a6326f97a50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.449596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914cf6e-1573-418e-8cdc-a6326f97a50e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.461704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 294/578] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:53.463148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914cf6e-1573-418e-8cdc-a6326f97a50e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.483187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ec184-3cfb-4aa4-af2f-0b2dcf975fb5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.489970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:53.517786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a963e7-0c2f-4493-8c04-9efd75ace016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.518477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a963e7-0c2f-4493-8c04-9efd75ace016 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.518760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a963e7-0c2f-4493-8c04-9efd75ace016 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.519034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a963e7-0c2f-4493-8c04-9efd75ace016 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.519860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a963e7-0c2f-4493-8c04-9efd75ace016 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:53.520164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a963e7-0c2f-4493-8c04-9efd75ace016 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.521586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a963e7-0c2f-4493-8c04-9efd75ace016 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.538167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 285/579] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:53.538997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a963e7-0c2f-4493-8c04-9efd75ace016 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.554821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:53.573057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914cf6e-1573-418e-8cdc-a6326f97a50e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.607970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7272468-eef8-4311-93f3-8beaf1595013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.608621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7272468-eef8-4311-93f3-8beaf1595013 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.608913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7272468-eef8-4311-93f3-8beaf1595013 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.609192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7272468-eef8-4311-93f3-8beaf1595013 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.609904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7272468-eef8-4311-93f3-8beaf1595013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:53.610212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7272468-eef8-4311-93f3-8beaf1595013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.611613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7272468-eef8-4311-93f3-8beaf1595013 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.622436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 295/580] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:53.623229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7272468-eef8-4311-93f3-8beaf1595013 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.640845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a963e7-0c2f-4493-8c04-9efd75ace016 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.675946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b14f5-1ef2-468e-81c1-54fe7990694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.676547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b14f5-1ef2-468e-81c1-54fe7990694a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.676833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b14f5-1ef2-468e-81c1-54fe7990694a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.677109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b14f5-1ef2-468e-81c1-54fe7990694a None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.677856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b14f5-1ef2-468e-81c1-54fe7990694a None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:53.678165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b14f5-1ef2-468e-81c1-54fe7990694a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.679558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b14f5-1ef2-468e-81c1-54fe7990694a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.687926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 286/581] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:53.688833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b14f5-1ef2-468e-81c1-54fe7990694a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.718614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:53.724434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7272468-eef8-4311-93f3-8beaf1595013 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.758560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2af25d-8ec1-4b72-854c-79de185c8a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.758802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2af25d-8ec1-4b72-854c-79de185c8a58 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.759091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2af25d-8ec1-4b72-854c-79de185c8a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.759367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2af25d-8ec1-4b72-854c-79de185c8a58 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.760195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2af25d-8ec1-4b72-854c-79de185c8a58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:53.760489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2af25d-8ec1-4b72-854c-79de185c8a58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.761915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2af25d-8ec1-4b72-854c-79de185c8a58 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.774032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 296/582] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:53.774861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2af25d-8ec1-4b72-854c-79de185c8a58 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.787114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:53.792426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b14f5-1ef2-468e-81c1-54fe7990694a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.825363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29a340-2acb-4a36-ac38-94f44e51065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.826141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29a340-2acb-4a36-ac38-94f44e51065c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.826453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29a340-2acb-4a36-ac38-94f44e51065c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.826730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29a340-2acb-4a36-ac38-94f44e51065c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.833137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29a340-2acb-4a36-ac38-94f44e51065c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.834597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29a340-2acb-4a36-ac38-94f44e51065c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ca29a340-2acb-4a36-ac38-94f44e51065c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:19:53.848731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:53.849763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:53.850869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:19:53.850869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:19:53.850869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:19:53.850869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:19:53.850869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:19:53.850869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:19:53.850869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:53.850869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:53.854650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 287/583] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:53.856190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29a340-2acb-4a36-ac38-94f44e51065c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.875166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2af25d-8ec1-4b72-854c-79de185c8a58 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.908535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570ca29-081f-4e42-ad7d-5b0b9e021030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.909357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570ca29-081f-4e42-ad7d-5b0b9e021030 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.909584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570ca29-081f-4e42-ad7d-5b0b9e021030 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.909858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570ca29-081f-4e42-ad7d-5b0b9e021030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.920115 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570ca29-081f-4e42-ad7d-5b0b9e021030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.921597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570ca29-081f-4e42-ad7d-5b0b9e021030 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:53.938157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-9570ca29-081f-4e42-ad7d-5b0b9e021030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:53.938870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:53.939796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:53.940953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:53.940953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:53.940953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:53.940953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:53.940953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 297/584] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:53.940953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570ca29-081f-4e42-ad7d-5b0b9e021030 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:53.953072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29a340-2acb-4a36-ac38-94f44e51065c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:53.988083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd5380-c231-45f9-8b06-3a999a123005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:53.988859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd5380-c231-45f9-8b06-3a999a123005 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:53.989145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd5380-c231-45f9-8b06-3a999a123005 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:53.989425 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd5380-c231-45f9-8b06-3a999a123005 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:53.996941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd5380-c231-45f9-8b06-3a999a123005 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:53.998401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd5380-c231-45f9-8b06-3a999a123005 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.002072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-7bdd5380-c231-45f9-8b06-3a999a123005 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:54.013292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:54.014442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 288/585] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:54.015570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd5380-c231-45f9-8b06-3a999a123005 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.042837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570ca29-081f-4e42-ad7d-5b0b9e021030 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:54.077131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d01f2-d004-4df8-ad02-7abb24f49267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:54.077923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d01f2-d004-4df8-ad02-7abb24f49267 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:54.078211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d01f2-d004-4df8-ad02-7abb24f49267 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:54.078521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d01f2-d004-4df8-ad02-7abb24f49267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:54.089310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d01f2-d004-4df8-ad02-7abb24f49267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:54.090791 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d01f2-d004-4df8-ad02-7abb24f49267 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-558d01f2-d004-4df8-ad02-7abb24f49267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:54.107860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:54.108949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:54.110168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:54.110168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:54.110168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:54.110168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:54.110168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 298/586] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:54.110168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d01f2-d004-4df8-ad02-7abb24f49267 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.115947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd5380-c231-45f9-8b06-3a999a123005 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:54.149165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad704d-9921-4e85-a2f9-7e342c6362e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:54.149804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad704d-9921-4e85-a2f9-7e342c6362e1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:54.150075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad704d-9921-4e85-a2f9-7e342c6362e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:54.150379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad704d-9921-4e85-a2f9-7e342c6362e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:54.151753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad704d-9921-4e85-a2f9-7e342c6362e1 None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=67ae1a0fbb4f44e6b60281ce63dc68fe) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:54.152063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad704d-9921-4e85-a2f9-7e342c6362e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:54.153494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad704d-9921-4e85-a2f9-7e342c6362e1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.158868 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 289/587] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:19:54 2022] GET /identity/v3/role_assignments?user.id=67ae1a0fbb4f44e6b60281ce63dc68fe&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:54.159641 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad704d-9921-4e85-a2f9-7e342c6362e1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.180769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:54.233198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d01f2-d004-4df8-ad02-7abb24f49267 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:54.248034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:54.272625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1516d8-46f9-4886-ab2b-be91eefacc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:54.273416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1516d8-46f9-4886-ab2b-be91eefacc82 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:54.273705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1516d8-46f9-4886-ab2b-be91eefacc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:54.274103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1516d8-46f9-4886-ab2b-be91eefacc82 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:54.274945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1516d8-46f9-4886-ab2b-be91eefacc82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:54.275258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1516d8-46f9-4886-ab2b-be91eefacc82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:54.277644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1516d8-46f9-4886-ab2b-be91eefacc82 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.281324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad704d-9921-4e85-a2f9-7e342c6362e1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:54.295797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 299/588] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:54.295797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1516d8-46f9-4886-ab2b-be91eefacc82 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.330533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60843a-4480-4956-8c4c-9606f8acdf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:54.331532 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60843a-4480-4956-8c4c-9606f8acdf7b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:54.332007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60843a-4480-4956-8c4c-9606f8acdf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:54.332290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60843a-4480-4956-8c4c-9606f8acdf7b None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:54.333029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60843a-4480-4956-8c4c-9606f8acdf7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:54.333340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60843a-4480-4956-8c4c-9606f8acdf7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:54.334729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60843a-4480-4956-8c4c-9606f8acdf7b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.347497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 290/589] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:54.348310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60843a-4480-4956-8c4c-9606f8acdf7b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.419006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1516d8-46f9-4886-ab2b-be91eefacc82 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:54.420688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:54.454067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60843a-4480-4956-8c4c-9606f8acdf7b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:54.458096 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271908a-ae91-4a56-ba99-e6b5113be4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:54.458800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271908a-ae91-4a56-ba99-e6b5113be4ff None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:54.459088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271908a-ae91-4a56-ba99-e6b5113be4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:54.459367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271908a-ae91-4a56-ba99-e6b5113be4ff None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:54.460206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271908a-ae91-4a56-ba99-e6b5113be4ff None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:54.460516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271908a-ae91-4a56-ba99-e6b5113be4ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:54.462435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271908a-ae91-4a56-ba99-e6b5113be4ff None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.486083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 300/590] 10.222.0.44 () {56 vars in 1139 bytes} [Fri Jun 24 10:19:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:54.486083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271908a-ae91-4a56-ba99-e6b5113be4ff None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.495691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6053a-5d08-49c1-9589-6c8653bff58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:54.496447 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6053a-5d08-49c1-9589-6c8653bff58e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:54.496807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6053a-5d08-49c1-9589-6c8653bff58e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:54.497097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6053a-5d08-49c1-9589-6c8653bff58e None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:54.497831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6053a-5d08-49c1-9589-6c8653bff58e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:54.498146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6053a-5d08-49c1-9589-6c8653bff58e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:54.499560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6053a-5d08-49c1-9589-6c8653bff58e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.512028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 291/591] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:54.512826 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6053a-5d08-49c1-9589-6c8653bff58e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.521997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:54.605761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271908a-ae91-4a56-ba99-e6b5113be4ff None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:54.627542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6053a-5d08-49c1-9589-6c8653bff58e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:54.642564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af5d05-21f1-499a-92f7-622932426b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:54.643613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af5d05-21f1-499a-92f7-622932426b67 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:54.643900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af5d05-21f1-499a-92f7-622932426b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:54.644179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af5d05-21f1-499a-92f7-622932426b67 None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/a66ff3915a784ddcb3925aadcb416700/roles/d26d3b3eb78246ffb76d8ad95123c66c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:54.659518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af5d05-21f1-499a-92f7-622932426b67 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=a66ff3915a784ddcb3925aadcb416700, role_id=d26d3b3eb78246ffb76d8ad95123c66c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:54.660642 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:54.660948 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af5d05-21f1-499a-92f7-622932426b67 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.669003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732c592-89c3-4c1d-ba3b-c884e9419ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:54.669833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732c592-89c3-4c1d-ba3b-c884e9419ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:54.670126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732c592-89c3-4c1d-ba3b-c884e9419ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:54.670564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732c592-89c3-4c1d-ba3b-c884e9419ec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:54.682395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 301/592] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:19:54 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/a66ff3915a784ddcb3925aadcb416700/roles/d26d3b3eb78246ffb76d8ad95123c66c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:54.682395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af5d05-21f1-499a-92f7-622932426b67 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.682724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732c592-89c3-4c1d-ba3b-c884e9419ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:54.682724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732c592-89c3-4c1d-ba3b-c884e9419ec4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-9732c592-89c3-4c1d-ba3b-c884e9419ec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:19:54.699869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:54.700856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:54.701739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:19:54.701739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:19:54.701739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:19:54.701739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:19:54.701739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:19:54.701739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:19:54.701739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:54.701739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:54.701739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 292/593] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:54.702219 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732c592-89c3-4c1d-ba3b-c884e9419ec4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.828457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732c592-89c3-4c1d-ba3b-c884e9419ec4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:54.832636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:54.836865 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af5d05-21f1-499a-92f7-622932426b67 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:54.878246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64eb0a0-79ed-4f2c-a0a9-e5b0d8a9787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:54.879197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eb0a0-79ed-4f2c-a0a9-e5b0d8a9787b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:54.879582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eb0a0-79ed-4f2c-a0a9-e5b0d8a9787b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:54.879900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64eb0a0-79ed-4f2c-a0a9-e5b0d8a9787b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:54.885803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6749e-d583-41a5-8474-7b65bd8635b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:54.885803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6749e-d583-41a5-8474-7b65bd8635b9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:54.885803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6749e-d583-41a5-8474-7b65bd8635b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:54.886230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6749e-d583-41a5-8474-7b65bd8635b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:54.890169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64eb0a0-79ed-4f2c-a0a9-e5b0d8a9787b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:54.891749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64eb0a0-79ed-4f2c-a0a9-e5b0d8a9787b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.899665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6749e-d583-41a5-8474-7b65bd8635b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:54.901756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6749e-d583-41a5-8474-7b65bd8635b9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a64eb0a0-79ed-4f2c-a0a9-e5b0d8a9787b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:54.909151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:54.910281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:54.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:54.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:54.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:54.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:54.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:54.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:54.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:54.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:54.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:19:54.911427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:54.911981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 293/594] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:19:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:54.912584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64eb0a0-79ed-4f2c-a0a9-e5b0d8a9787b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-45b6749e-d583-41a5-8474-7b65bd8635b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:54.926730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:54.927861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:54.928940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:54.928940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:54.928940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:54.928940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:54.929718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 302/595] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:54.930513 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6749e-d583-41a5-8474-7b65bd8635b9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:54.989725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:55.042247 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6749e-d583-41a5-8474-7b65bd8635b9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:55.057146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64eb0a0-79ed-4f2c-a0a9-e5b0d8a9787b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:55.084188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:55.090873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc1261-6949-45b1-a2d1-cb7d9dce67f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:55.091935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc1261-6949-45b1-a2d1-cb7d9dce67f0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:55.092427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc1261-6949-45b1-a2d1-cb7d9dce67f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:55.093082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc1261-6949-45b1-a2d1-cb7d9dce67f0 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:55.094188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc1261-6949-45b1-a2d1-cb7d9dce67f0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:55.094931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc1261-6949-45b1-a2d1-cb7d9dce67f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:55.095564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc42a-86b1-4fc6-905a-5c26586886f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:55.096364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc42a-86b1-4fc6-905a-5c26586886f8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:55.096753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc42a-86b1-4fc6-905a-5c26586886f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:55.096990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc1261-6949-45b1-a2d1-cb7d9dce67f0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:55.097228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc42a-86b1-4fc6-905a-5c26586886f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:55.098128 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cc42a-86b1-4fc6-905a-5c26586886f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:55.098701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cc42a-86b1-4fc6-905a-5c26586886f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:55.100133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cc42a-86b1-4fc6-905a-5c26586886f8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:55.117849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 294/596] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:55.117849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc42a-86b1-4fc6-905a-5c26586886f8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:55.125811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 303/597] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Jun 24 10:19:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:55.131671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc1261-6949-45b1-a2d1-cb7d9dce67f0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:55.239150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc42a-86b1-4fc6-905a-5c26586886f8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:55.251669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:55.252673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc1261-6949-45b1-a2d1-cb7d9dce67f0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:55.292098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816867fa-179a-4459-8927-c4f63e8f361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:55.292819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816867fa-179a-4459-8927-c4f63e8f361b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:55.293109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816867fa-179a-4459-8927-c4f63e8f361b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:55.293391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816867fa-179a-4459-8927-c4f63e8f361b None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:55.294129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816867fa-179a-4459-8927-c4f63e8f361b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:55.294469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816867fa-179a-4459-8927-c4f63e8f361b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:55.295912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816867fa-179a-4459-8927-c4f63e8f361b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:55.299815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284a864-8a57-46ad-9936-471b5b76e2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:55.301230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284a864-8a57-46ad-9936-471b5b76e2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:55.301713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284a864-8a57-46ad-9936-471b5b76e2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:55.302192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284a864-8a57-46ad-9936-471b5b76e2f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:55.313580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 295/598] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:55.314499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816867fa-179a-4459-8927-c4f63e8f361b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:55.315812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284a864-8a57-46ad-9936-471b5b76e2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:55.317758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284a864-8a57-46ad-9936-471b5b76e2f6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3284a864-8a57-46ad-9936-471b5b76e2f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:55.346604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:55.347523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:55.348435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:55.348435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:55.348435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:55.348435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:55.351016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 304/599] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:55.351987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284a864-8a57-46ad-9936-471b5b76e2f6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:55.409214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:55.427822 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816867fa-179a-4459-8927-c4f63e8f361b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:55.473044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d849f1c-af2f-489a-9e2e-3c838118ebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:55.474176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d849f1c-af2f-489a-9e2e-3c838118ebeb None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:55.474651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d849f1c-af2f-489a-9e2e-3c838118ebeb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:55.475076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284a864-8a57-46ad-9936-471b5b76e2f6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:55.475193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d849f1c-af2f-489a-9e2e-3c838118ebeb None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/2fe27c3402a741f0a80d87ae6ecd3f3d/roles/d26d3b3eb78246ffb76d8ad95123c66c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:55.496601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d849f1c-af2f-489a-9e2e-3c838118ebeb None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=2fe27c3402a741f0a80d87ae6ecd3f3d, role_id=d26d3b3eb78246ffb76d8ad95123c66c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:55.498804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d849f1c-af2f-489a-9e2e-3c838118ebeb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:55.515017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5e415-4f23-44fa-bfd7-2f73d62bca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:55.515265 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 296/600] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:19:55 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/2fe27c3402a741f0a80d87ae6ecd3f3d/roles/d26d3b3eb78246ffb76d8ad95123c66c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:55.516267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d849f1c-af2f-489a-9e2e-3c838118ebeb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:55.524159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5e415-4f23-44fa-bfd7-2f73d62bca53 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:55.524944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5e415-4f23-44fa-bfd7-2f73d62bca53 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:55.525350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5e415-4f23-44fa-bfd7-2f73d62bca53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:55.543402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5e415-4f23-44fa-bfd7-2f73d62bca53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:55.545163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5e415-4f23-44fa-bfd7-2f73d62bca53 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:55.565553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-45a5e415-4f23-44fa-bfd7-2f73d62bca53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:19:55.580207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:55.581161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:55.582074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:19:55.582074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:19:55.582074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:19:55.582074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:19:55.582074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:19:55.582074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:19:55.582074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:55.582074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:55.582074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 305/601] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:55.591984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5e415-4f23-44fa-bfd7-2f73d62bca53 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:55.727097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d849f1c-af2f-489a-9e2e-3c838118ebeb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:55.763964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5e415-4f23-44fa-bfd7-2f73d62bca53 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:55.765723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddd361-18a8-4e9b-a3e7-a0d111019815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:55.765879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:55.767136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddd361-18a8-4e9b-a3e7-a0d111019815 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:55.767635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddd361-18a8-4e9b-a3e7-a0d111019815 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:55.768119 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddd361-18a8-4e9b-a3e7-a0d111019815 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:55.769052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddd361-18a8-4e9b-a3e7-a0d111019815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:55.769591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddd361-18a8-4e9b-a3e7-a0d111019815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:55.771257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddd361-18a8-4e9b-a3e7-a0d111019815 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:55.784474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 297/602] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:55.790243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddd361-18a8-4e9b-a3e7-a0d111019815 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:55.804697 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109d675-ed54-498b-b8ce-f19d07fb28df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:55.805366 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109d675-ed54-498b-b8ce-f19d07fb28df None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:55.805648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109d675-ed54-498b-b8ce-f19d07fb28df None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:55.805926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109d675-ed54-498b-b8ce-f19d07fb28df None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:55.806733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109d675-ed54-498b-b8ce-f19d07fb28df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:55.807594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109d675-ed54-498b-b8ce-f19d07fb28df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:55.809129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109d675-ed54-498b-b8ce-f19d07fb28df None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:55.826378 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 306/603] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:55.829828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109d675-ed54-498b-b8ce-f19d07fb28df None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:55.949046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:55.981240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109d675-ed54-498b-b8ce-f19d07fb28df None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:55.985900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddd361-18a8-4e9b-a3e7-a0d111019815 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:56.016414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bb174-d26d-4cea-a203-9d8a3e2b0cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:56.017295 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb174-d26d-4cea-a203-9d8a3e2b0cea None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:56.017578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb174-d26d-4cea-a203-9d8a3e2b0cea None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:56.017853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb174-d26d-4cea-a203-9d8a3e2b0cea None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/4160318c1b9b49539c6a2d8110289463/roles/d26d3b3eb78246ffb76d8ad95123c66c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:56.033315 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bb174-d26d-4cea-a203-9d8a3e2b0cea None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=4160318c1b9b49539c6a2d8110289463, role_id=d26d3b3eb78246ffb76d8ad95123c66c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:56.034882 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bb174-d26d-4cea-a203-9d8a3e2b0cea None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:56.058621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2aa8b-3178-46df-8837-498ee747f9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:56.061264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2aa8b-3178-46df-8837-498ee747f9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:56.061556 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2aa8b-3178-46df-8837-498ee747f9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:56.061831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2aa8b-3178-46df-8837-498ee747f9b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:56.062927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 307/604] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:19:55 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/4160318c1b9b49539c6a2d8110289463/roles/d26d3b3eb78246ffb76d8ad95123c66c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:56.071534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2aa8b-3178-46df-8837-498ee747f9b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:56.073290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2aa8b-3178-46df-8837-498ee747f9b8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-04c2aa8b-3178-46df-8837-498ee747f9b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:19:56.090558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:56.091544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:56.092444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:19:56.092444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:19:56.092444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:19:56.092444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:19:56.092444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:19:56.092444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:19:56.092444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:56.092444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:56.092444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 298/605] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:56.099131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bb174-d26d-4cea-a203-9d8a3e2b0cea None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:56.116355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:56.216551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bb174-d26d-4cea-a203-9d8a3e2b0cea None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:56.254428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1544e0-533d-4c61-8339-43452f1583f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:56.255072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1544e0-533d-4c61-8339-43452f1583f0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:56.255357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1544e0-533d-4c61-8339-43452f1583f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:56.255683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1544e0-533d-4c61-8339-43452f1583f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:56.256484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1544e0-533d-4c61-8339-43452f1583f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:56.256768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1544e0-533d-4c61-8339-43452f1583f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:56.258257 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1544e0-533d-4c61-8339-43452f1583f0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:56.271444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 308/606] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:56.279379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2aa8b-3178-46df-8837-498ee747f9b8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:56.310536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e0b42-92ca-4d8d-a42a-539eb25c1b14 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:56.311045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e0b42-92ca-4d8d-a42a-539eb25c1b14 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:56.311123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e0b42-92ca-4d8d-a42a-539eb25c1b14 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:56.312570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 309/607] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:19:56.317822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156b619-2879-40a3-95af-36320f34e6b5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:56.318108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156b619-2879-40a3-95af-36320f34e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:56.318473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156b619-2879-40a3-95af-36320f34e6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:56.336762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c156b619-2879-40a3-95af-36320f34e6b5 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:56.338220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c156b619-2879-40a3-95af-36320f34e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:56.416567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2aa8b-3178-46df-8837-498ee747f9b8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:56.436412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 310/608] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:56.461403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cd327-e92f-4e1c-a9c1-626904ed5478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:56.462343 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd327-e92f-4e1c-a9c1-626904ed5478 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:56.462657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd327-e92f-4e1c-a9c1-626904ed5478 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:56.462985 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cd327-e92f-4e1c-a9c1-626904ed5478 None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/a9cffe87117f447dacec4289f454a8ec/roles/d26d3b3eb78246ffb76d8ad95123c66c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:56.470064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156b619-2879-40a3-95af-36320f34e6b5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:56.472410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:56.491576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:56.500618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cd327-e92f-4e1c-a9c1-626904ed5478 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=a9cffe87117f447dacec4289f454a8ec, role_id=d26d3b3eb78246ffb76d8ad95123c66c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:56.502087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cd327-e92f-4e1c-a9c1-626904ed5478 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:56.526775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 299/609] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:19:56 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/a9cffe87117f447dacec4289f454a8ec/roles/d26d3b3eb78246ffb76d8ad95123c66c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:56.624371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156b619-2879-40a3-95af-36320f34e6b5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:56.679785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045f0a1-f356-4042-8971-406440b30a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:56.680610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045f0a1-f356-4042-8971-406440b30a80 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:56.680897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045f0a1-f356-4042-8971-406440b30a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:56.681176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045f0a1-f356-4042-8971-406440b30a80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:56.697733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045f0a1-f356-4042-8971-406440b30a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5045f0a1-f356-4042-8971-406440b30a80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:56.706090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:56.707789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:56.708659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:56.711436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 311/610] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:56.717656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cd327-e92f-4e1c-a9c1-626904ed5478 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:56.834906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cd327-e92f-4e1c-a9c1-626904ed5478 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:56.875140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9181e-b005-4baa-96d4-5eb7dd8b9c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:56.876765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9181e-b005-4baa-96d4-5eb7dd8b9c86 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:56.877279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9181e-b005-4baa-96d4-5eb7dd8b9c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:56.877805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9181e-b005-4baa-96d4-5eb7dd8b9c86 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:56.879043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9181e-b005-4baa-96d4-5eb7dd8b9c86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:56.879885 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9181e-b005-4baa-96d4-5eb7dd8b9c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:56.881480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9181e-b005-4baa-96d4-5eb7dd8b9c86 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:56.890995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 300/611] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:56.898392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045f0a1-f356-4042-8971-406440b30a80 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:56.959762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b11bfd-8c35-41e6-9e99-9b06d0f2e0d5 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:56.960384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b11bfd-8c35-41e6-9e99-9b06d0f2e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:56.960850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b11bfd-8c35-41e6-9e99-9b06d0f2e0d5 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:56.962683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 301/612] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:19:56.967876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c597f-1cfd-4af4-b00c-2eaada37e1eb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:56.968378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c597f-1cfd-4af4-b00c-2eaada37e1eb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:56.968839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c597f-1cfd-4af4-b00c-2eaada37e1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:56.994228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:57.002456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-080c597f-1cfd-4af4-b00c-2eaada37e1eb None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:57.003667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-080c597f-1cfd-4af4-b00c-2eaada37e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:57.043085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045f0a1-f356-4042-8971-406440b30a80 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:57.098793 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:57.120730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8555dec-ee74-422e-92f7-fa65066bc8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:57.122096 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8555dec-ee74-422e-92f7-fa65066bc8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:57.122632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8555dec-ee74-422e-92f7-fa65066bc8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:57.123132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8555dec-ee74-422e-92f7-fa65066bc8f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:57.139554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8555dec-ee74-422e-92f7-fa65066bc8f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:57.140029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 302/613] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:57.141703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8555dec-ee74-422e-92f7-fa65066bc8f5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:57.166378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c597f-1cfd-4af4-b00c-2eaada37e1eb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a8555dec-ee74-422e-92f7-fa65066bc8f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:57.167673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:57.168534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:57.169829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:57.169829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:57.169829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:57.169829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:57.169829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 312/614] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:57.174835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8555dec-ee74-422e-92f7-fa65066bc8f5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:57.278661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c597f-1cfd-4af4-b00c-2eaada37e1eb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:57.357104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8555dec-ee74-422e-92f7-fa65066bc8f5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:57.375237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:57.383083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641d6ab-7d4c-4520-8870-5fdc5e2a7308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:57.383896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641d6ab-7d4c-4520-8870-5fdc5e2a7308 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:57.384178 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641d6ab-7d4c-4520-8870-5fdc5e2a7308 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:57.384449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641d6ab-7d4c-4520-8870-5fdc5e2a7308 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:57.393681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48588e0-085d-4a2d-b946-714ffeccd6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:57.394362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48588e0-085d-4a2d-b946-714ffeccd6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:57.394659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48588e0-085d-4a2d-b946-714ffeccd6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:57.394939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48588e0-085d-4a2d-b946-714ffeccd6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:57.395826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48588e0-085d-4a2d-b946-714ffeccd6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:57.396139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48588e0-085d-4a2d-b946-714ffeccd6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:57.397507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48588e0-085d-4a2d-b946-714ffeccd6d1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:57.410577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 313/615] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:57.416199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48588e0-085d-4a2d-b946-714ffeccd6d1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:57.426963 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641d6ab-7d4c-4520-8870-5fdc5e2a7308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2641d6ab-7d4c-4520-8870-5fdc5e2a7308 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:57.435172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:57.436091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:57.436928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:57.442767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 303/616] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:57.451281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641d6ab-7d4c-4520-8870-5fdc5e2a7308 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:57.518718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:57.581745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641d6ab-7d4c-4520-8870-5fdc5e2a7308 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:57.618722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8f85b-26df-4bff-9574-37481102ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:57.620290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f85b-26df-4bff-9574-37481102ee01 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:57.620780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f85b-26df-4bff-9574-37481102ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:57.621258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f85b-26df-4bff-9574-37481102ee01 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:57.622206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8f85b-26df-4bff-9574-37481102ee01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:57.622743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8f85b-26df-4bff-9574-37481102ee01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:57.624337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8f85b-26df-4bff-9574-37481102ee01 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:57.633735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 304/617] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:57.640223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8f85b-26df-4bff-9574-37481102ee01 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:57.748562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8f85b-26df-4bff-9574-37481102ee01 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:57.756268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:57.768506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48588e0-085d-4a2d-b946-714ffeccd6d1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:57.785582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7bef1-002f-4645-b3ab-99f8e1521ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:57.786549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7bef1-002f-4645-b3ab-99f8e1521ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:57.786945 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7bef1-002f-4645-b3ab-99f8e1521ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:57.787332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7bef1-002f-4645-b3ab-99f8e1521ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:57.800518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7bef1-002f-4645-b3ab-99f8e1521ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:57.802188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7bef1-002f-4645-b3ab-99f8e1521ce4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c5a7bef1-002f-4645-b3ab-99f8e1521ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:57.821380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:57.822387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:57.823624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:57.823624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:57.823624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:57.823624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:57.823624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 305/618] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:57.828891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7bef1-002f-4645-b3ab-99f8e1521ce4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:57.927157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501340df-d6b5-49a0-99cc-4837493c374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:57.927899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501340df-d6b5-49a0-99cc-4837493c374e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:57.928189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501340df-d6b5-49a0-99cc-4837493c374e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:57.928464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501340df-d6b5-49a0-99cc-4837493c374e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:57.936878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7bef1-002f-4645-b3ab-99f8e1521ce4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:57.950970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501340df-d6b5-49a0-99cc-4837493c374e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:57.952430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501340df-d6b5-49a0-99cc-4837493c374e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-501340df-d6b5-49a0-99cc-4837493c374e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:57.968432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:57.969438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:57.970560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 314/619] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:19:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 554 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:57.975516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501340df-d6b5-49a0-99cc-4837493c374e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:58.004165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87143b-2939-4d08-b09e-5a1565012b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:58.005188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87143b-2939-4d08-b09e-5a1565012b3b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.005809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87143b-2939-4d08-b09e-5a1565012b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.006246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87143b-2939-4d08-b09e-5a1565012b3b None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.007473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87143b-2939-4d08-b09e-5a1565012b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:58.008334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87143b-2939-4d08-b09e-5a1565012b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:58.010381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87143b-2939-4d08-b09e-5a1565012b3b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:58.013402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:58.036679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 306/620] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:58.047529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87143b-2939-4d08-b09e-5a1565012b3b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:58.098773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:58.101964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501340df-d6b5-49a0-99cc-4837493c374e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:58.138172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0300a39-6ce2-4f2f-95dc-31d603f27e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:58.138908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0300a39-6ce2-4f2f-95dc-31d603f27e2f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.139200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0300a39-6ce2-4f2f-95dc-31d603f27e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.139525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0300a39-6ce2-4f2f-95dc-31d603f27e2f None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.140422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0300a39-6ce2-4f2f-95dc-31d603f27e2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:58.140738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0300a39-6ce2-4f2f-95dc-31d603f27e2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:58.142176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0300a39-6ce2-4f2f-95dc-31d603f27e2f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:58.161339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 315/621] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Jun 24 10:19:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:19:58.167362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0300a39-6ce2-4f2f-95dc-31d603f27e2f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:58.225825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87143b-2939-4d08-b09e-5a1565012b3b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:58.264036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8229ac8-9053-4b94-b394-a755bfd300a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:58.264846 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:58.266551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229ac8-9053-4b94-b394-a755bfd300a4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.267106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229ac8-9053-4b94-b394-a755bfd300a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.267654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229ac8-9053-4b94-b394-a755bfd300a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.273554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0300a39-6ce2-4f2f-95dc-31d603f27e2f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:58.277407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8229ac8-9053-4b94-b394-a755bfd300a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:58.279236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8229ac8-9053-4b94-b394-a755bfd300a4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d8229ac8-9053-4b94-b394-a755bfd300a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:19:58.296753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:58.297733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:58.298706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:58.298706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:58.298706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:19:58.298706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:19:58.298706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:19:58.298706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:19:58.298706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:19:58.298706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:19:58.298706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:19:58.298706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:58.301891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 307/622] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Jun 24 10:19:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:58.303508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7da5b-9a8f-42e1-890c-dcad190b09e3 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.304027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7da5b-9a8f-42e1-890c-dcad190b09e3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.304497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7da5b-9a8f-42e1-890c-dcad190b09e3 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.310046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 308/623] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:58.311153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7da5b-9a8f-42e1-890c-dcad190b09e3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:58.316282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f638585-26a8-445e-842a-9a043d270f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:58.316535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638585-26a8-445e-842a-9a043d270f64 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.316798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638585-26a8-445e-842a-9a043d270f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.317077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638585-26a8-445e-842a-9a043d270f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.327915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f638585-26a8-445e-842a-9a043d270f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:58.329482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f638585-26a8-445e-842a-9a043d270f64 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-0f638585-26a8-445e-842a-9a043d270f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:58.348526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:58.349465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:58.350795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:58.350795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:58.350795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:58.350795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:58.350795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 316/624] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:19:58.356494 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb805e65-0224-48fb-ba7e-5006b329158b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.356785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb805e65-0224-48fb-ba7e-5006b329158b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.357083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb805e65-0224-48fb-ba7e-5006b329158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.374008 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bb805e65-0224-48fb-ba7e-5006b329158b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:58.375236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bb805e65-0224-48fb-ba7e-5006b329158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:58.401972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:58.430743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7da5b-9a8f-42e1-890c-dcad190b09e3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:58.454395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 317/625] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:58.454395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb805e65-0224-48fb-ba7e-5006b329158b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:58.487775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad083b-72d7-4ece-a515-dfdfe49ba49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:58.488424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad083b-72d7-4ece-a515-dfdfe49ba49e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.489216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad083b-72d7-4ece-a515-dfdfe49ba49e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.489512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad083b-72d7-4ece-a515-dfdfe49ba49e None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.490515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad083b-72d7-4ece-a515-dfdfe49ba49e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:58.490829 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad083b-72d7-4ece-a515-dfdfe49ba49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:58.492968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad083b-72d7-4ece-a515-dfdfe49ba49e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:58.512121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 309/626] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Jun 24 10:19:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:58.513393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abf189-0915-434a-b480-45f5636b48cc None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.513678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abf189-0915-434a-b480-45f5636b48cc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.513956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abf189-0915-434a-b480-45f5636b48cc None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.515327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 310/627] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:58.519225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abf189-0915-434a-b480-45f5636b48cc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:58.531970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:58.560045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb805e65-0224-48fb-ba7e-5006b329158b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:58.600472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63d2d-9869-4eeb-8793-358c90387104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:58.601880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63d2d-9869-4eeb-8793-358c90387104 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.602167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63d2d-9869-4eeb-8793-358c90387104 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.602550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63d2d-9869-4eeb-8793-358c90387104 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.603275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea63d2d-9869-4eeb-8793-358c90387104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:58.603613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea63d2d-9869-4eeb-8793-358c90387104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:58.604982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea63d2d-9869-4eeb-8793-358c90387104 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:58.618938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 318/628] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:58.619506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63d2d-9869-4eeb-8793-358c90387104 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:58.632585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abf189-0915-434a-b480-45f5636b48cc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:58.673591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ea713-d6c1-42b7-8a20-8b58fef92f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:58.674745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ea713-d6c1-42b7-8a20-8b58fef92f4c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.675033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ea713-d6c1-42b7-8a20-8b58fef92f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.675319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ea713-d6c1-42b7-8a20-8b58fef92f4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.677451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:58.687167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ea713-d6c1-42b7-8a20-8b58fef92f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-574ea713-d6c1-42b7-8a20-8b58fef92f4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:58.694964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:58.696021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:58.696874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 311/629] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:58.698774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdc02-cdf7-4c16-9547-2ed5150fabb2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.698774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdc02-cdf7-4c16-9547-2ed5150fabb2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.698774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdc02-cdf7-4c16-9547-2ed5150fabb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.716629 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-408bdc02-cdf7-4c16-9547-2ed5150fabb2 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:58.717943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-408bdc02-cdf7-4c16-9547-2ed5150fabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:58.733258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63d2d-9869-4eeb-8793-358c90387104 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:58.767436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47c24b-5aa6-40d1-a4ec-4533d32ebb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:58.768006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47c24b-5aa6-40d1-a4ec-4533d32ebb89 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.768290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47c24b-5aa6-40d1-a4ec-4533d32ebb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.768564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47c24b-5aa6-40d1-a4ec-4533d32ebb89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.771325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:58.792785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 312/630] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:58.793729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bdc02-cdf7-4c16-9547-2ed5150fabb2 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:58.852253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47c24b-5aa6-40d1-a4ec-4533d32ebb89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:58.853822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47c24b-5aa6-40d1-a4ec-4533d32ebb89 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:58.908252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bdc02-cdf7-4c16-9547-2ed5150fabb2 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:58.934700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:58.947051 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9a5c6-250a-4288-b46b-76a1032abb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:58.948399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9a5c6-250a-4288-b46b-76a1032abb2d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:58.948683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9a5c6-250a-4288-b46b-76a1032abb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:58.948963 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9a5c6-250a-4288-b46b-76a1032abb2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:58.955867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9a5c6-250a-4288-b46b-76a1032abb2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:58.957313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9a5c6-250a-4288-b46b-76a1032abb2d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-79e9a5c6-250a-4288-b46b-76a1032abb2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:19:58.972060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:58.973015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:58.973924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:19:58.973924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:19:58.973924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:19:58.973924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:19:58.973924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:19:58.973924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:19:58.973924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:19:58.973924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:58.973924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 313/631] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:58.974830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9a5c6-250a-4288-b46b-76a1032abb2d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:58.988463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 319/632] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:58.988463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47c24b-5aa6-40d1-a4ec-4533d32ebb89 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.020556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:59.088272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9a5c6-250a-4288-b46b-76a1032abb2d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.092169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47c24b-5aa6-40d1-a4ec-4533d32ebb89 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.122033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02609f-25d3-4380-b13d-227e2d1d2dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:59.122726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02609f-25d3-4380-b13d-227e2d1d2dda None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.123012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02609f-25d3-4380-b13d-227e2d1d2dda None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.123289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02609f-25d3-4380-b13d-227e2d1d2dda None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.124043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02609f-25d3-4380-b13d-227e2d1d2dda None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:59.124351 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02609f-25d3-4380-b13d-227e2d1d2dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:59.125444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b313e73-9059-4ac3-b1b1-ee37171c6a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:59.125716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02609f-25d3-4380-b13d-227e2d1d2dda None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:59.126235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313e73-9059-4ac3-b1b1-ee37171c6a31 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.126551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313e73-9059-4ac3-b1b1-ee37171c6a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.126828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313e73-9059-4ac3-b1b1-ee37171c6a31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.133683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 314/633] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:59.134495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02609f-25d3-4380-b13d-227e2d1d2dda None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.137395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b313e73-9059-4ac3-b1b1-ee37171c6a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7b313e73-9059-4ac3-b1b1-ee37171c6a31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:19:59.145085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:59.146215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:59.147298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 320/634] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:59.148014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b313e73-9059-4ac3-b1b1-ee37171c6a31 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.188009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:59.242766 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:59.244782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02609f-25d3-4380-b13d-227e2d1d2dda None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.250294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b313e73-9059-4ac3-b1b1-ee37171c6a31 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.277044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81430532-e539-4729-9711-12d9ff81fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:59.278109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430532-e539-4729-9711-12d9ff81fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.278301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430532-e539-4729-9711-12d9ff81fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.278587 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430532-e539-4729-9711-12d9ff81fcc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.279669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81430532-e539-4729-9711-12d9ff81fcc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:59.279960 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81430532-e539-4729-9711-12d9ff81fcc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:59.281466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81430532-e539-4729-9711-12d9ff81fcc6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:59.283213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d3b29-7475-4f3a-8557-2139d3d5f210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:59.284001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d3b29-7475-4f3a-8557-2139d3d5f210 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.284290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d3b29-7475-4f3a-8557-2139d3d5f210 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.284565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d3b29-7475-4f3a-8557-2139d3d5f210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.293721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 315/635] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:59.295113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1f66-e6ff-4377-bfea-494c1b7e3e78 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.295406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1f66-e6ff-4377-bfea-494c1b7e3e78 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.295682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1f66-e6ff-4377-bfea-494c1b7e3e78 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.296915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 316/636] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:19:59.297614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1f66-e6ff-4377-bfea-494c1b7e3e78 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.300683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d3b29-7475-4f3a-8557-2139d3d5f210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:59.302131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d3b29-7475-4f3a-8557-2139d3d5f210 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-809d3b29-7475-4f3a-8557-2139d3d5f210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:59.319812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:59.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:59.321577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:59.321577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:59.321577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:59.321577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:59.321577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 321/637] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:59.322248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d3b29-7475-4f3a-8557-2139d3d5f210 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.403074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1f66-e6ff-4377-bfea-494c1b7e3e78 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.410593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:59.419351 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d3b29-7475-4f3a-8557-2139d3d5f210 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.439955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a45cb8-b9e3-4d9c-a1af-e245d12c23e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:59.440836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a45cb8-b9e3-4d9c-a1af-e245d12c23e8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.441217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a45cb8-b9e3-4d9c-a1af-e245d12c23e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.441581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a45cb8-b9e3-4d9c-a1af-e245d12c23e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.452290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a4d34-6b2a-44e2-b242-2b086df36b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:59.452530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a45cb8-b9e3-4d9c-a1af-e245d12c23e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:59.452941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4d34-6b2a-44e2-b242-2b086df36b8c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.453224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4d34-6b2a-44e2-b242-2b086df36b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.453501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4d34-6b2a-44e2-b242-2b086df36b8c None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.453780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a45cb8-b9e3-4d9c-a1af-e245d12c23e8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:59.454237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a4d34-6b2a-44e2-b242-2b086df36b8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:59.454568 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a4d34-6b2a-44e2-b242-2b086df36b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:59.455919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a4d34-6b2a-44e2-b242-2b086df36b8c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:59.463695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 322/638] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:19:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:59.464441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a4d34-6b2a-44e2-b242-2b086df36b8c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a2a45cb8-b9e3-4d9c-a1af-e245d12c23e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:59.471818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:59.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:59.473612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:59.473612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:59.473612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:59.473612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:19:59.473612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 317/639] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:59.474346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cbc60-aab3-4237-86b0-7f43c2984345 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.474473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cbc60-aab3-4237-86b0-7f43c2984345 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.474743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cbc60-aab3-4237-86b0-7f43c2984345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.480151 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:59.491059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7f8cbc60-aab3-4237-86b0-7f43c2984345 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:19:59.492241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7f8cbc60-aab3-4237-86b0-7f43c2984345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:19:59.577976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 318/640] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:59.577976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cbc60-aab3-4237-86b0-7f43c2984345 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.578259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a4d34-6b2a-44e2-b242-2b086df36b8c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.608629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b95c81-14b6-4309-a515-73f23eb9dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:59.609508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95c81-14b6-4309-a515-73f23eb9dd55 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.609790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95c81-14b6-4309-a515-73f23eb9dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.610060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95c81-14b6-4309-a515-73f23eb9dd55 None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/67ae1a0fbb4f44e6b60281ce63dc68fe/roles/d26d3b3eb78246ffb76d8ad95123c66c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.624735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b95c81-14b6-4309-a515-73f23eb9dd55 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=67ae1a0fbb4f44e6b60281ce63dc68fe, role_id=d26d3b3eb78246ffb76d8ad95123c66c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:59.626184 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b95c81-14b6-4309-a515-73f23eb9dd55 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:59.639199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 323/641] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:19:59 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/67ae1a0fbb4f44e6b60281ce63dc68fe/roles/d26d3b3eb78246ffb76d8ad95123c66c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:19:59.640005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b95c81-14b6-4309-a515-73f23eb9dd55 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.672051 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:59.688049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cbc60-aab3-4237-86b0-7f43c2984345 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.708969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:59.730820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2223-6c9f-499b-bc12-0d4d546cea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:59.731535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2223-6c9f-499b-bc12-0d4d546cea65 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.731828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2223-6c9f-499b-bc12-0d4d546cea65 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.732103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2223-6c9f-499b-bc12-0d4d546cea65 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.732841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2223-6c9f-499b-bc12-0d4d546cea65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:59.733152 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2223-6c9f-499b-bc12-0d4d546cea65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:59.734594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2223-6c9f-499b-bc12-0d4d546cea65 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:59.748037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 319/642] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:59.748919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2223-6c9f-499b-bc12-0d4d546cea65 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.763875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b95c81-14b6-4309-a515-73f23eb9dd55 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.803887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ffc62-2694-47e5-8561-4a45e6f204b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:59.804867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ffc62-2694-47e5-8561-4a45e6f204b6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.805160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ffc62-2694-47e5-8561-4a45e6f204b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.805815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ffc62-2694-47e5-8561-4a45e6f204b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.824433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ffc62-2694-47e5-8561-4a45e6f204b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:59.825893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ffc62-2694-47e5-8561-4a45e6f204b6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-316ffc62-2694-47e5-8561-4a45e6f204b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:19:59.845896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:19:59.847114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:19:59.848035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:19:59.848035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:19:59.848035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:19:59.848035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:19:59.848035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 324/643] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:19:59.848035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ffc62-2694-47e5-8561-4a45e6f204b6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.867841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2223-6c9f-499b-bc12-0d4d546cea65 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.902110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0cd8e-d6db-4f1a-8cec-1dbbc52ee78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:19:59.902811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0cd8e-d6db-4f1a-8cec-1dbbc52ee78e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:19:59.903099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0cd8e-d6db-4f1a-8cec-1dbbc52ee78e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:19:59.903379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0cd8e-d6db-4f1a-8cec-1dbbc52ee78e None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:19:59.904104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0cd8e-d6db-4f1a-8cec-1dbbc52ee78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:19:59.904412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0cd8e-d6db-4f1a-8cec-1dbbc52ee78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:19:59.905787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0cd8e-d6db-4f1a-8cec-1dbbc52ee78e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:19:59.917877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 320/644] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:19:59.918688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0cd8e-d6db-4f1a-8cec-1dbbc52ee78e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:19:59.930835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:59.965519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ffc62-2694-47e5-8561-4a45e6f204b6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:19:59.977340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:00.006938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a9577-3d41-441d-b6f9-1ef4fe5cb7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.007746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a9577-3d41-441d-b6f9-1ef4fe5cb7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.008033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a9577-3d41-441d-b6f9-1ef4fe5cb7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.008312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a9577-3d41-441d-b6f9-1ef4fe5cb7f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.019358 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a9577-3d41-441d-b6f9-1ef4fe5cb7f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:00.026455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0cd8e-d6db-4f1a-8cec-1dbbc52ee78e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-f17a9577-3d41-441d-b6f9-1ef4fe5cb7f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:00.026938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:00.027917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 325/645] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:19:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:00.028898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a9577-3d41-441d-b6f9-1ef4fe5cb7f7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.068816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed3ceb-42fd-41a9-b304-bb95880e2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.070474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed3ceb-42fd-41a9-b304-bb95880e2342 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.070791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed3ceb-42fd-41a9-b304-bb95880e2342 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.071074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed3ceb-42fd-41a9-b304-bb95880e2342 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.078810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed3ceb-42fd-41a9-b304-bb95880e2342 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:00.080932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed3ceb-42fd-41a9-b304-bb95880e2342 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e2ed3ceb-42fd-41a9-b304-bb95880e2342 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:00.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:00.100150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:00.101923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:00.101923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:00.101923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:00.101923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:00.101923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:00.101923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:00.101923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:00.101923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:00.103198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 321/646] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:00.104818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed3ceb-42fd-41a9-b304-bb95880e2342 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.140098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a9577-3d41-441d-b6f9-1ef4fe5cb7f7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:00.179245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edf8d1-cf2b-4e90-b1ba-a32e64662fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.179913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edf8d1-cf2b-4e90-b1ba-a32e64662fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.180201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edf8d1-cf2b-4e90-b1ba-a32e64662fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.180482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edf8d1-cf2b-4e90-b1ba-a32e64662fc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.180681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:00.181205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edf8d1-cf2b-4e90-b1ba-a32e64662fc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:00.181545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edf8d1-cf2b-4e90-b1ba-a32e64662fc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:00.183848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edf8d1-cf2b-4e90-b1ba-a32e64662fc8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:00.197663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 326/647] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:00.198599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edf8d1-cf2b-4e90-b1ba-a32e64662fc8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.236086 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:00.237997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed3ceb-42fd-41a9-b304-bb95880e2342 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:00.275859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f0118-953f-48d9-8ac3-e1013ad803e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.276778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f0118-953f-48d9-8ac3-e1013ad803e5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.277068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f0118-953f-48d9-8ac3-e1013ad803e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.277348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f0118-953f-48d9-8ac3-e1013ad803e5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.288206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f0118-953f-48d9-8ac3-e1013ad803e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:00.290110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f0118-953f-48d9-8ac3-e1013ad803e5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-168f0118-953f-48d9-8ac3-e1013ad803e5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:00.311356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:00.312309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:00.313273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:00.313273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:00.313273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:00.313273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:00.313273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:00.313273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:00.313273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:00.313273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:00.313273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 10:20:00.313273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:00.314321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edf8d1-cf2b-4e90-b1ba-a32e64662fc8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:00.314562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 322/648] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:00.315291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f0118-953f-48d9-8ac3-e1013ad803e5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.353086 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f230c8-2cb7-4ec1-9b40-ce530efa8a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.354219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f230c8-2cb7-4ec1-9b40-ce530efa8a88 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.354554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f230c8-2cb7-4ec1-9b40-ce530efa8a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.354832 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f230c8-2cb7-4ec1-9b40-ce530efa8a88 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.355578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f230c8-2cb7-4ec1-9b40-ce530efa8a88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:00.355886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f230c8-2cb7-4ec1-9b40-ce530efa8a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:00.357252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f230c8-2cb7-4ec1-9b40-ce530efa8a88 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:00.366885 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 327/649] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:00.368154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f230c8-2cb7-4ec1-9b40-ce530efa8a88 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.429402 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f0118-953f-48d9-8ac3-e1013ad803e5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:00.458522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:00.467578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:00.468030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53282-c429-41e6-aaa0-8c955b4b409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.468564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53282-c429-41e6-aaa0-8c955b4b409c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.468792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53282-c429-41e6-aaa0-8c955b4b409c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.469072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53282-c429-41e6-aaa0-8c955b4b409c None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.470158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d53282-c429-41e6-aaa0-8c955b4b409c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:00.470532 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d53282-c429-41e6-aaa0-8c955b4b409c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:00.472114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d53282-c429-41e6-aaa0-8c955b4b409c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:00.478426 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f230c8-2cb7-4ec1-9b40-ce530efa8a88 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:00.485158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 323/650] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:00.485873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53282-c429-41e6-aaa0-8c955b4b409c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.518621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d9a0a-7852-4a1d-b1af-dbcf4a641e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.519427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d9a0a-7852-4a1d-b1af-dbcf4a641e32 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.519716 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d9a0a-7852-4a1d-b1af-dbcf4a641e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.519997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d9a0a-7852-4a1d-b1af-dbcf4a641e32 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.528210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d9a0a-7852-4a1d-b1af-dbcf4a641e32 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:00.529651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d9a0a-7852-4a1d-b1af-dbcf4a641e32 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-fe9d9a0a-7852-4a1d-b1af-dbcf4a641e32 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:00.547500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:00.548530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 328/651] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:00.549765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d9a0a-7852-4a1d-b1af-dbcf4a641e32 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.612715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53282-c429-41e6-aaa0-8c955b4b409c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:00.648897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7931583-f419-41cd-8a10-288e1d9de0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.649564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931583-f419-41cd-8a10-288e1d9de0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.649848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931583-f419-41cd-8a10-288e1d9de0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.650126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931583-f419-41cd-8a10-288e1d9de0d2 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.651515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7931583-f419-41cd-8a10-288e1d9de0d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:00.651830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7931583-f419-41cd-8a10-288e1d9de0d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:00.653265 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7931583-f419-41cd-8a10-288e1d9de0d2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:00.661539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d9a0a-7852-4a1d-b1af-dbcf4a641e32 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:00.675496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 324/652] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:00.675496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7931583-f419-41cd-8a10-288e1d9de0d2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.698617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bb60b-c1c3-4c5e-851c-912d2df20c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.699469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bb60b-c1c3-4c5e-851c-912d2df20c51 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.699762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bb60b-c1c3-4c5e-851c-912d2df20c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.700045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bb60b-c1c3-4c5e-851c-912d2df20c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.711868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bb60b-c1c3-4c5e-851c-912d2df20c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:00.713847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bb60b-c1c3-4c5e-851c-912d2df20c51 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:00.722909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3d7bb60b-c1c3-4c5e-851c-912d2df20c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:00.733357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:00.734440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:00.735562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:00.735562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:00.735562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:00.735562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:00.735562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 329/653] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:00.735854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bb60b-c1c3-4c5e-851c-912d2df20c51 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.740319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:00.785678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7931583-f419-41cd-8a10-288e1d9de0d2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:00.822722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3994ad-4651-4c54-8e02-c9af4e7c366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.823394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3994ad-4651-4c54-8e02-c9af4e7c366c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.823678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3994ad-4651-4c54-8e02-c9af4e7c366c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.823952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3994ad-4651-4c54-8e02-c9af4e7c366c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.824785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3994ad-4651-4c54-8e02-c9af4e7c366c None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=a66ff3915a784ddcb3925aadcb416700) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:00.825100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3994ad-4651-4c54-8e02-c9af4e7c366c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:00.826584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3994ad-4651-4c54-8e02-c9af4e7c366c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:00.842384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 325/654] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/role_assignments?user.id=a66ff3915a784ddcb3925aadcb416700&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:00.842384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3994ad-4651-4c54-8e02-c9af4e7c366c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.849860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bb60b-c1c3-4c5e-851c-912d2df20c51 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:00.906519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5059e9d-0f5d-4358-bc05-dcfe320add82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:00.907289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5059e9d-0f5d-4358-bc05-dcfe320add82 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:00.907578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5059e9d-0f5d-4358-bc05-dcfe320add82 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:00.907860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5059e9d-0f5d-4358-bc05-dcfe320add82 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:00.908914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5059e9d-0f5d-4358-bc05-dcfe320add82 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:00.909230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5059e9d-0f5d-4358-bc05-dcfe320add82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:00.911489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5059e9d-0f5d-4358-bc05-dcfe320add82 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:00.935584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 330/655] 10.222.0.44 () {56 vars in 1139 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:00.936547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5059e9d-0f5d-4358-bc05-dcfe320add82 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:00.988240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3994ad-4651-4c54-8e02-c9af4e7c366c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:01.003491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:01.022775 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:01.041055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29611087-50e4-4a5d-884e-b2b1503247fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:01.041727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611087-50e4-4a5d-884e-b2b1503247fc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:01.042014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611087-50e4-4a5d-884e-b2b1503247fc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:01.042292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29611087-50e4-4a5d-884e-b2b1503247fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:01.075989 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5059e9d-0f5d-4358-bc05-dcfe320add82 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:01.119995 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcd647-3806-4f51-9a14-26f5db16819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:01.120659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcd647-3806-4f51-9a14-26f5db16819f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:01.120944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcd647-3806-4f51-9a14-26f5db16819f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:01.121221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcd647-3806-4f51-9a14-26f5db16819f None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:01.121947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcd647-3806-4f51-9a14-26f5db16819f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:01.122256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcd647-3806-4f51-9a14-26f5db16819f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:01.123145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29611087-50e4-4a5d-884e-b2b1503247fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:01.123666 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcd647-3806-4f51-9a14-26f5db16819f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:01.124993 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29611087-50e4-4a5d-884e-b2b1503247fc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:01.140234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 331/656] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:01.140234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcd647-3806-4f51-9a14-26f5db16819f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:01.256226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 326/657] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:01.256226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29611087-50e4-4a5d-884e-b2b1503247fc None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:01.268469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:01.269143 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcd647-3806-4f51-9a14-26f5db16819f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:01.294466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:01.308884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5726e-c214-40fb-aa98-9308aab66527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:01.309828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5726e-c214-40fb-aa98-9308aab66527 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:01.310318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5726e-c214-40fb-aa98-9308aab66527 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:01.310783 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5726e-c214-40fb-aa98-9308aab66527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:01.386133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29611087-50e4-4a5d-884e-b2b1503247fc None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:01.396585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5726e-c214-40fb-aa98-9308aab66527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:01.398636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5726e-c214-40fb-aa98-9308aab66527 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:01.424506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f012fc-7c5d-4584-a47e-16490b3b9d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:01.425574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f012fc-7c5d-4584-a47e-16490b3b9d54 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:01.426012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f012fc-7c5d-4584-a47e-16490b3b9d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:01.426950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f012fc-7c5d-4584-a47e-16490b3b9d54 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:01.437835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f012fc-7c5d-4584-a47e-16490b3b9d54 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:01.439324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f012fc-7c5d-4584-a47e-16490b3b9d54 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-76f012fc-7c5d-4584-a47e-16490b3b9d54 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:01.461605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:01.462747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 327/658] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:01.468707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f012fc-7c5d-4584-a47e-16490b3b9d54 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:01.529675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 332/659] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:01.530521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5726e-c214-40fb-aa98-9308aab66527 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:01.555643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:01.564205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:01.614031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f012fc-7c5d-4584-a47e-16490b3b9d54 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:01.653005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5726e-c214-40fb-aa98-9308aab66527 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:01.662385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39297c6e-d334-42b9-be9e-e504e2e05927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:01.664998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39297c6e-d334-42b9-be9e-e504e2e05927 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:01.664998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39297c6e-d334-42b9-be9e-e504e2e05927 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:01.664998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39297c6e-d334-42b9-be9e-e504e2e05927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:01.674502 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39297c6e-d334-42b9-be9e-e504e2e05927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:01.676167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39297c6e-d334-42b9-be9e-e504e2e05927 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:01.695358 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bdf0e-7e1a-4bf3-8b3e-fa0798024e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-39297c6e-d334-42b9-be9e-e504e2e05927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:01.695584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:01.696442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:01.697891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:01.697891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:01.697891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:01.697891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:01.698137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bdf0e-7e1a-4bf3-8b3e-fa0798024e6a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:01.698137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bdf0e-7e1a-4bf3-8b3e-fa0798024e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:01.698137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bdf0e-7e1a-4bf3-8b3e-fa0798024e6a None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:01.698137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bdf0e-7e1a-4bf3-8b3e-fa0798024e6a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:01.698420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bdf0e-7e1a-4bf3-8b3e-fa0798024e6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:01.702379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bdf0e-7e1a-4bf3-8b3e-fa0798024e6a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:01.702576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 328/660] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:01.702978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39297c6e-d334-42b9-be9e-e504e2e05927 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:01.722868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 333/661] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Jun 24 10:20:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:01.723739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bdf0e-7e1a-4bf3-8b3e-fa0798024e6a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:01.812140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:01.812588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39297c6e-d334-42b9-be9e-e504e2e05927 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:01.832969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bdf0e-7e1a-4bf3-8b3e-fa0798024e6a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:01.836019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:01.850341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63561c0-4e34-47a4-abd0-ba9704068293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:01.851163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63561c0-4e34-47a4-abd0-ba9704068293 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:01.851461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63561c0-4e34-47a4-abd0-ba9704068293 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:01.851726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63561c0-4e34-47a4-abd0-ba9704068293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:01.863680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63561c0-4e34-47a4-abd0-ba9704068293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:01.865166 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63561c0-4e34-47a4-abd0-ba9704068293 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:01.869980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11fdcf-1864-44a0-aa2b-35d2c58fabc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:01.870669 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fdcf-1864-44a0-aa2b-35d2c58fabc6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:01.870957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fdcf-1864-44a0-aa2b-35d2c58fabc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:01.871235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fdcf-1864-44a0-aa2b-35d2c58fabc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:01.871952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11fdcf-1864-44a0-aa2b-35d2c58fabc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:01.872258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11fdcf-1864-44a0-aa2b-35d2c58fabc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:01.873606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11fdcf-1864-44a0-aa2b-35d2c58fabc6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d63561c0-4e34-47a4-abd0-ba9704068293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:01.883467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:01.885235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:01.886987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:01.886987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:01.886987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:01.886987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:01.886987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 329/662] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:01.886987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63561c0-4e34-47a4-abd0-ba9704068293 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:01.890741 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 334/663] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:01.891585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ffa33-2e0b-44b2-8c29-195e67566990 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:01.891894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ffa33-2e0b-44b2-8c29-195e67566990 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:01.892157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ffa33-2e0b-44b2-8c29-195e67566990 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:01.897683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 335/664] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:01.897683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ffa33-2e0b-44b2-8c29-195e67566990 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:01.995167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63561c0-4e34-47a4-abd0-ba9704068293 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:02.002874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ffa33-2e0b-44b2-8c29-195e67566990 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:02.030072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551a6bf-1c76-41e1-bc2d-c22122da9681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:02.030755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551a6bf-1c76-41e1-bc2d-c22122da9681 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.031046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551a6bf-1c76-41e1-bc2d-c22122da9681 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.031328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551a6bf-1c76-41e1-bc2d-c22122da9681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.036711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d287134-7fb6-4510-b078-72dd1059e95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:02.037379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d287134-7fb6-4510-b078-72dd1059e95b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.037666 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d287134-7fb6-4510-b078-72dd1059e95b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.037949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d287134-7fb6-4510-b078-72dd1059e95b None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.038745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d287134-7fb6-4510-b078-72dd1059e95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:02.039057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d287134-7fb6-4510-b078-72dd1059e95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:02.040418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d287134-7fb6-4510-b078-72dd1059e95b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:02.050507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:02.054548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 336/665] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:02.055366 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d287134-7fb6-4510-b078-72dd1059e95b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:02.081575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:02.109509 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551a6bf-1c76-41e1-bc2d-c22122da9681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:02.111155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551a6bf-1c76-41e1-bc2d-c22122da9681 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:02.165585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d287134-7fb6-4510-b078-72dd1059e95b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:02.203745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef572876-0e4a-4a13-b7ee-d814310fb6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:02.204896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572876-0e4a-4a13-b7ee-d814310fb6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.205339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572876-0e4a-4a13-b7ee-d814310fb6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.205788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572876-0e4a-4a13-b7ee-d814310fb6b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.213057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef572876-0e4a-4a13-b7ee-d814310fb6b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:02.214746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef572876-0e4a-4a13-b7ee-d814310fb6b7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:02.221075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 330/666] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:02.221075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83da56f-4d39-4e06-afb4-88233e09556a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.221075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83da56f-4d39-4e06-afb4-88233e09556a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.221075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83da56f-4d39-4e06-afb4-88233e09556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-ef572876-0e4a-4a13-b7ee-d814310fb6b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:02.234492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:02.235397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:02.236309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:02.236309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:02.236309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:02.236309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:02.236309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:02.236309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:02.236309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:02.236309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:02.236769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a83da56f-4d39-4e06-afb4-88233e09556a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:02.237280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a83da56f-4d39-4e06-afb4-88233e09556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:02.239851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 337/667] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:02.239851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef572876-0e4a-4a13-b7ee-d814310fb6b7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:02.304902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:02.309622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 331/668] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:02.310496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83da56f-4d39-4e06-afb4-88233e09556a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:02.314818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:02.357941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef572876-0e4a-4a13-b7ee-d814310fb6b7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:02.393610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18f1b-f5bb-4378-8d48-3848da7ff81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:02.394426 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18f1b-f5bb-4378-8d48-3848da7ff81b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.394967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18f1b-f5bb-4378-8d48-3848da7ff81b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.394967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18f1b-f5bb-4378-8d48-3848da7ff81b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.401923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd18f1b-f5bb-4378-8d48-3848da7ff81b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:02.403384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd18f1b-f5bb-4378-8d48-3848da7ff81b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-efd18f1b-f5bb-4378-8d48-3848da7ff81b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:02.418228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:02.419139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:02.420027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:02.420027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:02.420027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:02.420027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:02.420027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:02.420027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:02.420027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:02.420027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:02.420027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 338/669] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:02.420516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18f1b-f5bb-4378-8d48-3848da7ff81b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:02.426543 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83da56f-4d39-4e06-afb4-88233e09556a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:02.461174 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1927-055e-4d0d-8bdd-62a2a7448f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:02.461962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1927-055e-4d0d-8bdd-62a2a7448f6a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.462243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1927-055e-4d0d-8bdd-62a2a7448f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.462546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1927-055e-4d0d-8bdd-62a2a7448f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.472804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1927-055e-4d0d-8bdd-62a2a7448f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:02.474299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1927-055e-4d0d-8bdd-62a2a7448f6a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1b3b1927-055e-4d0d-8bdd-62a2a7448f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:02.492471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:02.493434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:02.494944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:02.494944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:02.494944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:02.494944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:02.494944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 332/670] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:02.495238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1927-055e-4d0d-8bdd-62a2a7448f6a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:02.533595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18f1b-f5bb-4378-8d48-3848da7ff81b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:02.554661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:02.555974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:02.575378 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d5c58-5536-4025-9031-87708028c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:02.576051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d5c58-5536-4025-9031-87708028c3bc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.576340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d5c58-5536-4025-9031-87708028c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.576621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d5c58-5536-4025-9031-87708028c3bc None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.577411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d5c58-5536-4025-9031-87708028c3bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:02.577725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d5c58-5536-4025-9031-87708028c3bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:02.579193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d5c58-5536-4025-9031-87708028c3bc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:02.591968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 339/671] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:02.592623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d5c58-5536-4025-9031-87708028c3bc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:02.615130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1927-055e-4d0d-8bdd-62a2a7448f6a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:02.653020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee2f95-4735-4a8e-b2e2-9912157b1af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:02.653813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee2f95-4735-4a8e-b2e2-9912157b1af7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.654101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee2f95-4735-4a8e-b2e2-9912157b1af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.654397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee2f95-4735-4a8e-b2e2-9912157b1af7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.665451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee2f95-4735-4a8e-b2e2-9912157b1af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c2ee2f95-4735-4a8e-b2e2-9912157b1af7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:02.673320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:02.674811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:02.675696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 333/672] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:20:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:02.676423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee2f95-4735-4a8e-b2e2-9912157b1af7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:02.709750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d5c58-5536-4025-9031-87708028c3bc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:02.745905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eade05-0adc-4840-99df-299361fc548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:02.746737 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eade05-0adc-4840-99df-299361fc548a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.747114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eade05-0adc-4840-99df-299361fc548a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.747503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eade05-0adc-4840-99df-299361fc548a None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.748384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eade05-0adc-4840-99df-299361fc548a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:02.749231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eade05-0adc-4840-99df-299361fc548a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:02.750301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eade05-0adc-4840-99df-299361fc548a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:02.763686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 340/673] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:02.764722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eade05-0adc-4840-99df-299361fc548a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:02.785865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee2f95-4735-4a8e-b2e2-9912157b1af7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:02.804594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:02.810110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:02.825833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03d2c3-9dfa-4db0-9962-0f12d380f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:02.826670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03d2c3-9dfa-4db0-9962-0f12d380f60e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.827049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03d2c3-9dfa-4db0-9962-0f12d380f60e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.827455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03d2c3-9dfa-4db0-9962-0f12d380f60e None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.828233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03d2c3-9dfa-4db0-9962-0f12d380f60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:02.828636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03d2c3-9dfa-4db0-9962-0f12d380f60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:02.830093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03d2c3-9dfa-4db0-9962-0f12d380f60e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:02.846742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 334/674] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:02.847800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03d2c3-9dfa-4db0-9962-0f12d380f60e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:02.873209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eade05-0adc-4840-99df-299361fc548a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:02.918468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186c325-675c-4bf4-aede-d3d2249c149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:02.919211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186c325-675c-4bf4-aede-d3d2249c149a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:02.919501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186c325-675c-4bf4-aede-d3d2249c149a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:02.920006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186c325-675c-4bf4-aede-d3d2249c149a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:02.921097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186c325-675c-4bf4-aede-d3d2249c149a None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=2fe27c3402a741f0a80d87ae6ecd3f3d) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:02.921537 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186c325-675c-4bf4-aede-d3d2249c149a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:02.924045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186c325-675c-4bf4-aede-d3d2249c149a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:02.938599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 341/675] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:02 2022] GET /identity/v3/role_assignments?user.id=2fe27c3402a741f0a80d87ae6ecd3f3d&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:02.938599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186c325-675c-4bf4-aede-d3d2249c149a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:02.970382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03d2c3-9dfa-4db0-9962-0f12d380f60e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:03.012946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6ae54-69df-44d9-9d25-59cf0fe430f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:03.014178 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6ae54-69df-44d9-9d25-59cf0fe430f8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.014617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6ae54-69df-44d9-9d25-59cf0fe430f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.014897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6ae54-69df-44d9-9d25-59cf0fe430f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.015673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6ae54-69df-44d9-9d25-59cf0fe430f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:03.016318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6ae54-69df-44d9-9d25-59cf0fe430f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:03.018442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6ae54-69df-44d9-9d25-59cf0fe430f8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:03.029951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 335/676] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:20:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:03.030860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6ae54-69df-44d9-9d25-59cf0fe430f8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:03.066144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186c325-675c-4bf4-aede-d3d2249c149a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:03.069919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:03.082810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:03.109319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208aaa1-8a13-4d8d-b87a-fb08e7fb8354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:03.110066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208aaa1-8a13-4d8d-b87a-fb08e7fb8354 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.110452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208aaa1-8a13-4d8d-b87a-fb08e7fb8354 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.110794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208aaa1-8a13-4d8d-b87a-fb08e7fb8354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.111630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208aaa1-8a13-4d8d-b87a-fb08e7fb8354 None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=4160318c1b9b49539c6a2d8110289463) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:03.111940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208aaa1-8a13-4d8d-b87a-fb08e7fb8354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:03.113364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208aaa1-8a13-4d8d-b87a-fb08e7fb8354 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:03.121171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 342/677] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:02 2022] GET /identity/v3/role_assignments?user.id=4160318c1b9b49539c6a2d8110289463&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:03.122053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208aaa1-8a13-4d8d-b87a-fb08e7fb8354 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:03.164735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6ae54-69df-44d9-9d25-59cf0fe430f8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:03.217109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769271-d43e-4377-80f5-32227af87503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:03.218096 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769271-d43e-4377-80f5-32227af87503 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.218411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769271-d43e-4377-80f5-32227af87503 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.218699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769271-d43e-4377-80f5-32227af87503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.229339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58769271-d43e-4377-80f5-32227af87503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:03.231634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58769271-d43e-4377-80f5-32227af87503 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-58769271-d43e-4377-80f5-32227af87503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:03.251943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:03.253134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:03.254217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:03.254217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:03.254217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:03.254217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:03.254217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:03.254217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:03.254217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:03.254217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:03.254217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 336/678] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:03.254994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbdf00-d22a-4047-87b3-b427e878e764 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.255289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbdf00-d22a-4047-87b3-b427e878e764 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.255566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbdf00-d22a-4047-87b3-b427e878e764 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.257084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 337/679] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:03.257393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208aaa1-8a13-4d8d-b87a-fb08e7fb8354 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:03.258707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbdf00-d22a-4047-87b3-b427e878e764 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:03.306957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d1efe-b2d8-4956-90a7-e5b37c4a7445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:03.308050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1efe-b2d8-4956-90a7-e5b37c4a7445 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.308504 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1efe-b2d8-4956-90a7-e5b37c4a7445 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.308927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1efe-b2d8-4956-90a7-e5b37c4a7445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.321092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d1efe-b2d8-4956-90a7-e5b37c4a7445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:03.322893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d1efe-b2d8-4956-90a7-e5b37c4a7445 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-214d1efe-b2d8-4956-90a7-e5b37c4a7445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:03.343441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:03.344556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:03.345632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:03.345632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:03.345632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:03.345632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:03.351344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 343/680] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:03.351344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c26f-19e1-42d6-9736-6a5320ab43f7 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.351344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c26f-19e1-42d6-9736-6a5320ab43f7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.351344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c26f-19e1-42d6-9736-6a5320ab43f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.370270 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8408c26f-19e1-42d6-9736-6a5320ab43f7 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:03.371514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8408c26f-19e1-42d6-9736-6a5320ab43f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:03.386327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:03.388140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:03.394889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbdf00-d22a-4047-87b3-b427e878e764 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:03.441736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1fe0-db18-464c-916c-e8a57fc27868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:03.442918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1fe0-db18-464c-916c-e8a57fc27868 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.443728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1fe0-db18-464c-916c-e8a57fc27868 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.444408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1fe0-db18-464c-916c-e8a57fc27868 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.445361 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a1fe0-db18-464c-916c-e8a57fc27868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:03.445816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a1fe0-db18-464c-916c-e8a57fc27868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:03.447436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a1fe0-db18-464c-916c-e8a57fc27868 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:03.448570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 344/681] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:03.449706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408c26f-19e1-42d6-9736-6a5320ab43f7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:03.463706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 338/682] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:03.475413 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1fe0-db18-464c-916c-e8a57fc27868 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:03.581325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408c26f-19e1-42d6-9736-6a5320ab43f7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:03.593851 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1fe0-db18-464c-916c-e8a57fc27868 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:03.623953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee21934-c560-436a-9dfb-8e9579700033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:03.624680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee21934-c560-436a-9dfb-8e9579700033 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.624946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee21934-c560-436a-9dfb-8e9579700033 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.625226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee21934-c560-436a-9dfb-8e9579700033 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.625945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee21934-c560-436a-9dfb-8e9579700033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:03.626250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee21934-c560-436a-9dfb-8e9579700033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:03.627638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee21934-c560-436a-9dfb-8e9579700033 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:03.643900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 345/683] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:03.643900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee21934-c560-436a-9dfb-8e9579700033 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:03.646652 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a80b9a-cb25-44a7-baaf-2298603ac9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:03.647489 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a80b9a-cb25-44a7-baaf-2298603ac9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.647932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a80b9a-cb25-44a7-baaf-2298603ac9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.648349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a80b9a-cb25-44a7-baaf-2298603ac9f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.649335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a80b9a-cb25-44a7-baaf-2298603ac9f0 None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=a9cffe87117f447dacec4289f454a8ec) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:03.649790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a80b9a-cb25-44a7-baaf-2298603ac9f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:03.652479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a80b9a-cb25-44a7-baaf-2298603ac9f0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:03.656485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:03.666407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 339/684] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:03 2022] GET /identity/v3/role_assignments?user.id=a9cffe87117f447dacec4289f454a8ec&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:03.666407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a80b9a-cb25-44a7-baaf-2298603ac9f0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:03.709750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:03.801047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a80b9a-cb25-44a7-baaf-2298603ac9f0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:03.841605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129592c3-4773-4ac2-ae9a-52c6b358490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:03.842437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129592c3-4773-4ac2-ae9a-52c6b358490d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.842730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129592c3-4773-4ac2-ae9a-52c6b358490d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.843026 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129592c3-4773-4ac2-ae9a-52c6b358490d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.853383 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129592c3-4773-4ac2-ae9a-52c6b358490d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:03.854938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129592c3-4773-4ac2-ae9a-52c6b358490d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:03.864020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee21934-c560-436a-9dfb-8e9579700033 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-129592c3-4773-4ac2-ae9a-52c6b358490d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:03.870584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:03.871510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:03.872446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 340/685] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:03.877447 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129592c3-4773-4ac2-ae9a-52c6b358490d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:03.905782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee7697-a854-4d75-9aa7-8e04604893ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:03.907078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee7697-a854-4d75-9aa7-8e04604893ca None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:03.907623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee7697-a854-4d75-9aa7-8e04604893ca None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:03.908124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee7697-a854-4d75-9aa7-8e04604893ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:03.919778 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee7697-a854-4d75-9aa7-8e04604893ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-11ee7697-a854-4d75-9aa7-8e04604893ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:03.929407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:03.930398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:03.931320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:03.934205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 346/686] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:03.940986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee7697-a854-4d75-9aa7-8e04604893ca None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:03.971006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:03.990932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129592c3-4773-4ac2-ae9a-52c6b358490d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:04.023688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:04.039203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9fd6e-ad5d-46fc-899a-1ac45d3a0eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:04.040246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9fd6e-ad5d-46fc-899a-1ac45d3a0eab None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:04.040710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9fd6e-ad5d-46fc-899a-1ac45d3a0eab None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:04.041137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9fd6e-ad5d-46fc-899a-1ac45d3a0eab None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:04.042128 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9fd6e-ad5d-46fc-899a-1ac45d3a0eab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:04.042633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9fd6e-ad5d-46fc-899a-1ac45d3a0eab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:04.044409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9fd6e-ad5d-46fc-899a-1ac45d3a0eab None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:04.060166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee7697-a854-4d75-9aa7-8e04604893ca None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:04.065313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 341/687] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Jun 24 10:20:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:04.070888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9fd6e-ad5d-46fc-899a-1ac45d3a0eab None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:04.098255 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e8703-79d2-4dda-82fc-89717acb096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:04.099198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e8703-79d2-4dda-82fc-89717acb096b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:04.099584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e8703-79d2-4dda-82fc-89717acb096b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:04.100154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e8703-79d2-4dda-82fc-89717acb096b None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:04.100984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e8703-79d2-4dda-82fc-89717acb096b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:04.101393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e8703-79d2-4dda-82fc-89717acb096b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:04.103048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e8703-79d2-4dda-82fc-89717acb096b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:04.112868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 347/688] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:04.118004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e8703-79d2-4dda-82fc-89717acb096b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:04.184364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9fd6e-ad5d-46fc-899a-1ac45d3a0eab None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:04.223061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc2f58-ca2c-4acb-9046-506bb9cc6982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:04.223959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc2f58-ca2c-4acb-9046-506bb9cc6982 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:04.224394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc2f58-ca2c-4acb-9046-506bb9cc6982 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:04.225003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc2f58-ca2c-4acb-9046-506bb9cc6982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:04.226101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e8703-79d2-4dda-82fc-89717acb096b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:04.239047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:04.257533 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:04.271391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaffa4-a301-4ef5-ac88-1e443d1605e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:04.272191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaffa4-a301-4ef5-ac88-1e443d1605e8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:04.272477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaffa4-a301-4ef5-ac88-1e443d1605e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:04.272756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaffa4-a301-4ef5-ac88-1e443d1605e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:04.294587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaffa4-a301-4ef5-ac88-1e443d1605e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:04.296154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaffa4-a301-4ef5-ac88-1e443d1605e8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:04.311853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc2f58-ca2c-4acb-9046-506bb9cc6982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:04.313662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc2f58-ca2c-4acb-9046-506bb9cc6982 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-e8aaffa4-a301-4ef5-ac88-1e443d1605e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:04.325129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:04.326067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:04.327319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:04.327319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:04.327319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:04.327319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:04.327319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 348/689] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:04.332395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaffa4-a301-4ef5-ac88-1e443d1605e8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:04.490614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 342/690] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 10:20:04.497956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc2f58-ca2c-4acb-9046-506bb9cc6982 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:04.522734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaffa4-a301-4ef5-ac88-1e443d1605e8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:04.576688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:04.611056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e7817-eda0-42c6-8c2b-2a66cf5f9ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:04.611740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e7817-eda0-42c6-8c2b-2a66cf5f9ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:04.612032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e7817-eda0-42c6-8c2b-2a66cf5f9ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:04.612318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e7817-eda0-42c6-8c2b-2a66cf5f9ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:04.613060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e7817-eda0-42c6-8c2b-2a66cf5f9ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:04.613371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e7817-eda0-42c6-8c2b-2a66cf5f9ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:04.614790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e7817-eda0-42c6-8c2b-2a66cf5f9ce7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:04.636847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc2f58-ca2c-4acb-9046-506bb9cc6982 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:04.646926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 349/691] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:04.653287 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e7817-eda0-42c6-8c2b-2a66cf5f9ce7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:04.706647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beb035-9803-4dd4-9c84-2500608bc7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:04.707440 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beb035-9803-4dd4-9c84-2500608bc7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:04.707718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beb035-9803-4dd4-9c84-2500608bc7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:04.707989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beb035-9803-4dd4-9c84-2500608bc7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:04.730696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:04.731391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14beb035-9803-4dd4-9c84-2500608bc7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:04.732850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14beb035-9803-4dd4-9c84-2500608bc7d9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-14beb035-9803-4dd4-9c84-2500608bc7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:04.774719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:04.776232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:04.777167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:04.777167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:04.777167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:04.777167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:04.782698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 343/692] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:04.783564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beb035-9803-4dd4-9c84-2500608bc7d9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:04.786529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e7817-eda0-42c6-8c2b-2a66cf5f9ce7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:04.823816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790938f-7ef2-4c2f-8ed1-5cebff61f925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:04.824620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790938f-7ef2-4c2f-8ed1-5cebff61f925 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:04.825012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790938f-7ef2-4c2f-8ed1-5cebff61f925 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:04.825301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790938f-7ef2-4c2f-8ed1-5cebff61f925 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:04.833102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790938f-7ef2-4c2f-8ed1-5cebff61f925 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:04.834646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790938f-7ef2-4c2f-8ed1-5cebff61f925 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5790938f-7ef2-4c2f-8ed1-5cebff61f925 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:04.850736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:04.851767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:04.852754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 350/693] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Jun 24 10:20:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:04.859317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790938f-7ef2-4c2f-8ed1-5cebff61f925 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:04.989724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:04.997291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beb035-9803-4dd4-9c84-2500608bc7d9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:05.019828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790938f-7ef2-4c2f-8ed1-5cebff61f925 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:05.026464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:05.033496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1121f-5df5-4d9d-a6f2-0ef8a2ad3a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:05.034176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1121f-5df5-4d9d-a6f2-0ef8a2ad3a72 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.034492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1121f-5df5-4d9d-a6f2-0ef8a2ad3a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.034771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1121f-5df5-4d9d-a6f2-0ef8a2ad3a72 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.035501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1121f-5df5-4d9d-a6f2-0ef8a2ad3a72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:05.035811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1121f-5df5-4d9d-a6f2-0ef8a2ad3a72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:05.037197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1121f-5df5-4d9d-a6f2-0ef8a2ad3a72 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:05.050850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 344/694] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:05.056212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1121f-5df5-4d9d-a6f2-0ef8a2ad3a72 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:05.103983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a8374-5348-4b80-98d9-337a3063a592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:05.104776 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8374-5348-4b80-98d9-337a3063a592 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.105067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8374-5348-4b80-98d9-337a3063a592 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.105344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8374-5348-4b80-98d9-337a3063a592 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.106202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a8374-5348-4b80-98d9-337a3063a592 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:05.106541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a8374-5348-4b80-98d9-337a3063a592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:05.108187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a8374-5348-4b80-98d9-337a3063a592 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:05.139606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 351/695] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Jun 24 10:20:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:05.141133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a8374-5348-4b80-98d9-337a3063a592 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:05.159174 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1121f-5df5-4d9d-a6f2-0ef8a2ad3a72 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:05.193956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde893bd-dadb-4ecd-9d78-82e577f1604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:05.194895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde893bd-dadb-4ecd-9d78-82e577f1604b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.195182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde893bd-dadb-4ecd-9d78-82e577f1604b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.195457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde893bd-dadb-4ecd-9d78-82e577f1604b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.203015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde893bd-dadb-4ecd-9d78-82e577f1604b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:05.204660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde893bd-dadb-4ecd-9d78-82e577f1604b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-fde893bd-dadb-4ecd-9d78-82e577f1604b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:05.220356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:05.221301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:05.222215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:05.222215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:05.222215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:05.222215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:05.222215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:05.222215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:05.222215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:05.222215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:05.222215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 345/696] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:05.227734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde893bd-dadb-4ecd-9d78-82e577f1604b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:05.247190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a8374-5348-4b80-98d9-337a3063a592 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:05.254752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:05.283175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634efd9-0930-4a4f-91bb-f74179f32792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:05.283756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634efd9-0930-4a4f-91bb-f74179f32792 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.284037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634efd9-0930-4a4f-91bb-f74179f32792 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.284363 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634efd9-0930-4a4f-91bb-f74179f32792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.317005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:05.337330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde893bd-dadb-4ecd-9d78-82e577f1604b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:05.357681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634efd9-0930-4a4f-91bb-f74179f32792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:05.359158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634efd9-0930-4a4f-91bb-f74179f32792 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:05.374673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2003d5-9e38-48f0-94b1-97e39aabf756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:05.375344 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2003d5-9e38-48f0-94b1-97e39aabf756 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.375631 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2003d5-9e38-48f0-94b1-97e39aabf756 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.375910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2003d5-9e38-48f0-94b1-97e39aabf756 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.376814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2003d5-9e38-48f0-94b1-97e39aabf756 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:05.377128 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2003d5-9e38-48f0-94b1-97e39aabf756 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:05.378691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2003d5-9e38-48f0-94b1-97e39aabf756 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:05.392030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 346/697] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:05.397702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2003d5-9e38-48f0-94b1-97e39aabf756 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:05.488326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 352/698] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 10:20:05.493860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634efd9-0930-4a4f-91bb-f74179f32792 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:05.517719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:05.567976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2003d5-9e38-48f0-94b1-97e39aabf756 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:05.579525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:05.608726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0925e21-e3fa-485e-9d67-b99e851a9e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:05.609634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0925e21-e3fa-485e-9d67-b99e851a9e82 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.610080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0925e21-e3fa-485e-9d67-b99e851a9e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.610542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0925e21-e3fa-485e-9d67-b99e851a9e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.611535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0925e21-e3fa-485e-9d67-b99e851a9e82 None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=67ae1a0fbb4f44e6b60281ce63dc68fe) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:05.612012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0925e21-e3fa-485e-9d67-b99e851a9e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:05.613602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0925e21-e3fa-485e-9d67-b99e851a9e82 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:05.620585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634efd9-0930-4a4f-91bb-f74179f32792 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:05.621078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 347/699] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:05 2022] GET /identity/v3/role_assignments?user.id=67ae1a0fbb4f44e6b60281ce63dc68fe&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:05.622465 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f45c3c-69e4-4594-82ed-ce5877ef032a None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.622755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f45c3c-69e4-4594-82ed-ce5877ef032a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.623062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f45c3c-69e4-4594-82ed-ce5877ef032a None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.624611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 348/700] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:05.625566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5aa50-7b1f-4c47-bb61-625009cf1051 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.625860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5aa50-7b1f-4c47-bb61-625009cf1051 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.626141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5aa50-7b1f-4c47-bb61-625009cf1051 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.630585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 349/701] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:05.633992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4821c9-9067-4c6e-b8a0-1ff8f59a3b1b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.634890 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4821c9-9067-4c6e-b8a0-1ff8f59a3b1b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.635173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4821c9-9067-4c6e-b8a0-1ff8f59a3b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.652947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3a4821c9-9067-4c6e-b8a0-1ff8f59a3b1b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:05.654234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3a4821c9-9067-4c6e-b8a0-1ff8f59a3b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:05.670998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e59f0-2ff5-4744-ab9a-5e5598a81998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:05.672192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e59f0-2ff5-4744-ab9a-5e5598a81998 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.672732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e59f0-2ff5-4744-ab9a-5e5598a81998 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.673352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e59f0-2ff5-4744-ab9a-5e5598a81998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.686852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e59f0-2ff5-4744-ab9a-5e5598a81998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:05.689738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e59f0-2ff5-4744-ab9a-5e5598a81998 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-854e59f0-2ff5-4744-ab9a-5e5598a81998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:05.711799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:05.712932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:05.713848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:05.713848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:05.713848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:05.713848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:05.717781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 353/702] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:05.719306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0500c6-931e-4860-9552-851a6cb94954 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.719597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0500c6-931e-4860-9552-851a6cb94954 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.719877 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0500c6-931e-4860-9552-851a6cb94954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.737818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7b0500c6-931e-4860-9552-851a6cb94954 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:05.739197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7b0500c6-931e-4860-9552-851a6cb94954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:05.760610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 350/703] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:05.760610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4821c9-9067-4c6e-b8a0-1ff8f59a3b1b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:05.841461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 354/704] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:05.842251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0500c6-931e-4860-9552-851a6cb94954 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:05.855971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:05.897570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4821c9-9067-4c6e-b8a0-1ff8f59a3b1b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:05.905707 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:05.945311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a79bb4-f025-43b3-868a-605a022da816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:05.946086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79bb4-f025-43b3-868a-605a022da816 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:05.946412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79bb4-f025-43b3-868a-605a022da816 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:05.946732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79bb4-f025-43b3-868a-605a022da816 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:05.947468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a79bb4-f025-43b3-868a-605a022da816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:05.947779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a79bb4-f025-43b3-868a-605a022da816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:05.949169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a79bb4-f025-43b3-868a-605a022da816 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:05.966095 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 351/705] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:05.970493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a79bb4-f025-43b3-868a-605a022da816 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:05.988200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0500c6-931e-4860-9552-851a6cb94954 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:06.031232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656a7a9-febe-4b76-b95f-33a2c28190ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:06.032271 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656a7a9-febe-4b76-b95f-33a2c28190ae None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.032619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656a7a9-febe-4b76-b95f-33a2c28190ae None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.032961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656a7a9-febe-4b76-b95f-33a2c28190ae None admin] PATH_INFO: `/v3/services/network` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.033677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656a7a9-febe-4b76-b95f-33a2c28190ae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:06.035165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656a7a9-febe-4b76-b95f-33a2c28190ae None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d656a7a9-febe-4b76-b95f-33a2c28190ae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:06.050221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:06.051319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:06.052269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 355/706] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:05 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:06.053076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656a7a9-febe-4b76-b95f-33a2c28190ae None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:06.088034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a79bb4-f025-43b3-868a-605a022da816 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:06.118598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:06.129052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2a8e0-76b1-49d9-8f50-fc5d6b32a80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:06.129653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2a8e0-76b1-49d9-8f50-fc5d6b32a80a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.130033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2a8e0-76b1-49d9-8f50-fc5d6b32a80a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.130461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2a8e0-76b1-49d9-8f50-fc5d6b32a80a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.144368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2a8e0-76b1-49d9-8f50-fc5d6b32a80a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:06.145995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2a8e0-76b1-49d9-8f50-fc5d6b32a80a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-6da2a8e0-76b1-49d9-8f50-fc5d6b32a80a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:06.164836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:06.165858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:06.166810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:06.166810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:06.166810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:06.166810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:06.171384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 352/707] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:06.172165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2a8e0-76b1-49d9-8f50-fc5d6b32a80a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:06.190230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656a7a9-febe-4b76-b95f-33a2c28190ae None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:06.200890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:06.233560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3900f-46d9-40b3-98c3-f7db28af6014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:06.234527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3900f-46d9-40b3-98c3-f7db28af6014 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.234879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3900f-46d9-40b3-98c3-f7db28af6014 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.235256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3900f-46d9-40b3-98c3-f7db28af6014 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.242829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3900f-46d9-40b3-98c3-f7db28af6014 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:06.244412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3900f-46d9-40b3-98c3-f7db28af6014 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4af3900f-46d9-40b3-98c3-f7db28af6014 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:06.260245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:06.261196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:06.262093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:06.262093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:06.262093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:06.262093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:06.262093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:06.262093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:06.262093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:06.262093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:06.266167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 356/708] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:06.267052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3900f-46d9-40b3-98c3-f7db28af6014 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:06.308577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2a8e0-76b1-49d9-8f50-fc5d6b32a80a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:06.353165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184dd32-74b9-4861-a9d1-995fa0d9434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:06.353887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184dd32-74b9-4861-a9d1-995fa0d9434d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.354175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184dd32-74b9-4861-a9d1-995fa0d9434d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.354478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184dd32-74b9-4861-a9d1-995fa0d9434d None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.355337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184dd32-74b9-4861-a9d1-995fa0d9434d None admin] RBAC: Adding query filter params (name=network) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:06.355653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184dd32-74b9-4861-a9d1-995fa0d9434d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:06.357026 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184dd32-74b9-4861-a9d1-995fa0d9434d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:06.362147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 353/709] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:06.363093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184dd32-74b9-4861-a9d1-995fa0d9434d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:06.395105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3900f-46d9-40b3-98c3-f7db28af6014 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:06.409032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:06.442947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01a69a-856d-407d-a9f1-910e3257b1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:06.443617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a69a-856d-407d-a9f1-910e3257b1dd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.443902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a69a-856d-407d-a9f1-910e3257b1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.444181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a69a-856d-407d-a9f1-910e3257b1dd None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.444904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a69a-856d-407d-a9f1-910e3257b1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:06.445211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a69a-856d-407d-a9f1-910e3257b1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:06.446622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a69a-856d-407d-a9f1-910e3257b1dd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:06.458579 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 357/710] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:06.459392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01a69a-856d-407d-a9f1-910e3257b1dd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:06.481226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184dd32-74b9-4861-a9d1-995fa0d9434d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:06.487939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:06.521082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d57616-92de-4596-84d8-a29beea05bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:06.521827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d57616-92de-4596-84d8-a29beea05bba None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.522044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d57616-92de-4596-84d8-a29beea05bba None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.522327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d57616-92de-4596-84d8-a29beea05bba None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.523155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d57616-92de-4596-84d8-a29beea05bba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:06.523465 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d57616-92de-4596-84d8-a29beea05bba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:06.524935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d57616-92de-4596-84d8-a29beea05bba None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:06.537175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 354/711] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:06.538544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b277fb7-8f08-4894-92e0-8178d423166c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.539038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b277fb7-8f08-4894-92e0-8178d423166c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.539526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b277fb7-8f08-4894-92e0-8178d423166c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.545606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 355/712] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:06.546423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b277fb7-8f08-4894-92e0-8178d423166c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:06.570220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01a69a-856d-407d-a9f1-910e3257b1dd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:06.607527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4c85-edd5-4bdc-8515-ddf458f2ffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:06.608204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4c85-edd5-4bdc-8515-ddf458f2ffa9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.608485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4c85-edd5-4bdc-8515-ddf458f2ffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.608768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4c85-edd5-4bdc-8515-ddf458f2ffa9 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.609480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a4c85-edd5-4bdc-8515-ddf458f2ffa9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:06.609812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a4c85-edd5-4bdc-8515-ddf458f2ffa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:06.611191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a4c85-edd5-4bdc-8515-ddf458f2ffa9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:06.619114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 358/713] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:06.620460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4c85-edd5-4bdc-8515-ddf458f2ffa9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:06.664928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b277fb7-8f08-4894-92e0-8178d423166c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:06.666701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:06.704679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df61770-e52f-4df4-8923-14e52df0a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:06.705380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df61770-e52f-4df4-8923-14e52df0a173 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.705668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df61770-e52f-4df4-8923-14e52df0a173 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.705949 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df61770-e52f-4df4-8923-14e52df0a173 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.706860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df61770-e52f-4df4-8923-14e52df0a173 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:06.708283 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df61770-e52f-4df4-8923-14e52df0a173 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:06.738378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 356/714] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:20:06 2022] POST /identity/v3/users => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:06.738378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae62748-0ffd-449b-9474-6eaa8e3e2f3b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.738378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae62748-0ffd-449b-9474-6eaa8e3e2f3b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.738378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae62748-0ffd-449b-9474-6eaa8e3e2f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.751525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:06.758444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-aae62748-0ffd-449b-9474-6eaa8e3e2f3b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:06.759984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-aae62748-0ffd-449b-9474-6eaa8e3e2f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:06.772384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4c85-edd5-4bdc-8515-ddf458f2ffa9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:06.840939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 357/715] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:06.866196 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae62748-0ffd-449b-9474-6eaa8e3e2f3b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:06.866598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511243-4d8c-460a-ab34-e4f97c40bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:06.867371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511243-4d8c-460a-ab34-e4f97c40bbef None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:06.867755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511243-4d8c-460a-ab34-e4f97c40bbef None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:06.868128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511243-4d8c-460a-ab34-e4f97c40bbef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:06.869650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6511243-4d8c-460a-ab34-e4f97c40bbef None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=a66ff3915a784ddcb3925aadcb416700) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:06.870089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6511243-4d8c-460a-ab34-e4f97c40bbef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:06.871611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6511243-4d8c-460a-ab34-e4f97c40bbef None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:06.887218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 359/716] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:06 2022] GET /identity/v3/role_assignments?user.id=a66ff3915a784ddcb3925aadcb416700&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:06.998994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:07.014790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae62748-0ffd-449b-9474-6eaa8e3e2f3b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:07.054160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2b6dc-f905-4d1d-9137-211dfda08c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:07.055177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2b6dc-f905-4d1d-9137-211dfda08c0e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:07.055461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2b6dc-f905-4d1d-9137-211dfda08c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:07.055734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2b6dc-f905-4d1d-9137-211dfda08c0e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:07.056980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2b6dc-f905-4d1d-9137-211dfda08c0e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:07.058450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2b6dc-f905-4d1d-9137-211dfda08c0e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a0b2b6dc-f905-4d1d-9137-211dfda08c0e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:07.073176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:07.074185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:07.075124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 358/717] 10.222.0.44 () {56 vars in 1129 bytes} [Fri Jun 24 10:20:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:07.082426 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511243-4d8c-460a-ab34-e4f97c40bbef None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:07.193279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511243-4d8c-460a-ab34-e4f97c40bbef None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:07.229528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e66a8-80e4-48d3-820c-24cef554087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:07.230585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e66a8-80e4-48d3-820c-24cef554087a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:07.231073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e66a8-80e4-48d3-820c-24cef554087a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:07.231549 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e66a8-80e4-48d3-820c-24cef554087a None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:07.232469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e66a8-80e4-48d3-820c-24cef554087a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:07.233007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e66a8-80e4-48d3-820c-24cef554087a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:07.234603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e66a8-80e4-48d3-820c-24cef554087a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:07.239842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 360/718] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Jun 24 10:20:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:07.245717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2b6dc-f905-4d1d-9137-211dfda08c0e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:07.355195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2b6dc-f905-4d1d-9137-211dfda08c0e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:07.403188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add406e-f673-45cd-a8e3-836555e69014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:07.404266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add406e-f673-45cd-a8e3-836555e69014 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:07.404756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add406e-f673-45cd-a8e3-836555e69014 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:07.405254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add406e-f673-45cd-a8e3-836555e69014 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:07.406169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add406e-f673-45cd-a8e3-836555e69014 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:07.406714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add406e-f673-45cd-a8e3-836555e69014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:07.408347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add406e-f673-45cd-a8e3-836555e69014 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:07.416533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 359/719] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Jun 24 10:20:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:08.100895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3ff3b-6c0b-4727-b171-1c15ced242fb None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:08.101451 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3ff3b-6c0b-4727-b171-1c15ced242fb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:08.101451 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3ff3b-6c0b-4727-b171-1c15ced242fb None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:08.103628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 361/720] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:08.108902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb0d1d-4c7d-42b9-b88e-73422add86a0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:08.109294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb0d1d-4c7d-42b9-b88e-73422add86a0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:08.109492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb0d1d-4c7d-42b9-b88e-73422add86a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:08.126253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-62eb0d1d-4c7d-42b9-b88e-73422add86a0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:08.127565 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-62eb0d1d-4c7d-42b9-b88e-73422add86a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:08.147786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:08.224736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 360/721] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:20:08.273159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3ff3b-6c0b-4727-b171-1c15ced242fb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:08.300472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:08.390519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3ff3b-6c0b-4727-b171-1c15ced242fb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:08.424139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e78562-a384-4d07-bc0b-1ad5bf8e00dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:08.424930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e78562-a384-4d07-bc0b-1ad5bf8e00dd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:08.425214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e78562-a384-4d07-bc0b-1ad5bf8e00dd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:08.425490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e78562-a384-4d07-bc0b-1ad5bf8e00dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:08.439318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e78562-a384-4d07-bc0b-1ad5bf8e00dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-65e78562-a384-4d07-bc0b-1ad5bf8e00dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:08.446978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:08.447969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:08.448827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 362/722] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:08.453993 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb0d1d-4c7d-42b9-b88e-73422add86a0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:08.592563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb0d1d-4c7d-42b9-b88e-73422add86a0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:08.641508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84012f35-d964-470a-9489-67cd8190071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:08.642120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012f35-d964-470a-9489-67cd8190071b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:08.642433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012f35-d964-470a-9489-67cd8190071b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:08.642718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012f35-d964-470a-9489-67cd8190071b None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:08.643477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84012f35-d964-470a-9489-67cd8190071b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:08.643787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84012f35-d964-470a-9489-67cd8190071b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:08.645160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84012f35-d964-470a-9489-67cd8190071b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:08.658700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 361/723] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:08.659674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e78562-a384-4d07-bc0b-1ad5bf8e00dd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:08.773405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:08.800185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e78562-a384-4d07-bc0b-1ad5bf8e00dd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:08.847183 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13084c21-e48a-4be8-9ed7-82ee24f9ef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:08.848016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13084c21-e48a-4be8-9ed7-82ee24f9ef56 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:08.848307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13084c21-e48a-4be8-9ed7-82ee24f9ef56 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:08.848580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13084c21-e48a-4be8-9ed7-82ee24f9ef56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:08.863508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13084c21-e48a-4be8-9ed7-82ee24f9ef56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:08.864943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13084c21-e48a-4be8-9ed7-82ee24f9ef56 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-13084c21-e48a-4be8-9ed7-82ee24f9ef56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:08.882338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:08.883349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:08.888458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:08.888458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:08.888458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:08.888458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:08.888458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 363/724] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:08.894527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84012f35-d964-470a-9489-67cd8190071b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:08.916978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:09.033056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84012f35-d964-470a-9489-67cd8190071b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:09.074389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d433d-41a7-4801-af00-a1550f7cdd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:09.075052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d433d-41a7-4801-af00-a1550f7cdd3f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.075340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d433d-41a7-4801-af00-a1550f7cdd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.075614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d433d-41a7-4801-af00-a1550f7cdd3f None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.076328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d433d-41a7-4801-af00-a1550f7cdd3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:09.076633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d433d-41a7-4801-af00-a1550f7cdd3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:09.077987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d433d-41a7-4801-af00-a1550f7cdd3f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:09.099659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 362/725] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:09.104734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13084c21-e48a-4be8-9ed7-82ee24f9ef56 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:09.132376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69588bb5-3499-4c13-b6c0-96314ddce66f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.133028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69588bb5-3499-4c13-b6c0-96314ddce66f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.133028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69588bb5-3499-4c13-b6c0-96314ddce66f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.134846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 363/726] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:09.156208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3507a-3f4d-4ae7-9b41-2beadf0d6495 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.156208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3507a-3f4d-4ae7-9b41-2beadf0d6495 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.156208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3507a-3f4d-4ae7-9b41-2beadf0d6495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.169802 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e9e3507a-3f4d-4ae7-9b41-2beadf0d6495 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:09.171574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e9e3507a-3f4d-4ae7-9b41-2beadf0d6495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:09.256175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13084c21-e48a-4be8-9ed7-82ee24f9ef56 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:09.291175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:09.296982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 364/727] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 10:20:09.302925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:09.319580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967a4e3-27f0-4195-8f49-275815b5a3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:09.320416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a4e3-27f0-4195-8f49-275815b5a3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.320700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a4e3-27f0-4195-8f49-275815b5a3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.320977 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a4e3-27f0-4195-8f49-275815b5a3c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.326517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3507a-3f4d-4ae7-9b41-2beadf0d6495 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:09.343178 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967a4e3-27f0-4195-8f49-275815b5a3c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:09.344658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967a4e3-27f0-4195-8f49-275815b5a3c7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4967a4e3-27f0-4195-8f49-275815b5a3c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:09.365484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:09.366502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:09.367440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:09.367440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:09.367440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:09.367440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:09.367440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:09.367440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:09.367440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:09.367440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:09.367440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:20:09.367440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:09.376008 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 364/728] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:09.380341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967a4e3-27f0-4195-8f49-275815b5a3c7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:09.475954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3507a-3f4d-4ae7-9b41-2beadf0d6495 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:09.507375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967a4e3-27f0-4195-8f49-275815b5a3c7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:09.514808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e705ba9-709c-4602-ab2c-0aa0a26d9d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:09.515505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705ba9-709c-4602-ab2c-0aa0a26d9d74 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.515789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705ba9-709c-4602-ab2c-0aa0a26d9d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.516066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705ba9-709c-4602-ab2c-0aa0a26d9d74 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.516981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e705ba9-709c-4602-ab2c-0aa0a26d9d74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:09.518255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e705ba9-709c-4602-ab2c-0aa0a26d9d74 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:09.536858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 365/729] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:20:09 2022] POST /identity/v3/services => generated 240 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:20:09.538829 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4bf4-c831-4119-b3b8-7d6155fd6642 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.539258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4bf4-c831-4119-b3b8-7d6155fd6642 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.541816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4bf4-c831-4119-b3b8-7d6155fd6642 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.541959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 366/730] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:09.553985 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e9ae1-7ab5-44b6-80bf-e912153fea5c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.554309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e9ae1-7ab5-44b6-80bf-e912153fea5c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.554678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e9ae1-7ab5-44b6-80bf-e912153fea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.575116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bdac1-2c87-4db4-9581-dfbb585af100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:09.576250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bdac1-2c87-4db4-9581-dfbb585af100 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.576743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bdac1-2c87-4db4-9581-dfbb585af100 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.577223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bdac1-2c87-4db4-9581-dfbb585af100 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.578306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bdac1-2c87-4db4-9581-dfbb585af100 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:09.578987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bdac1-2c87-4db4-9581-dfbb585af100 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:09.580829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bdac1-2c87-4db4-9581-dfbb585af100 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:09.603388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 365/731] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Jun 24 10:20:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:09.608938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-aa1e9ae1-7ab5-44b6-80bf-e912153fea5c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:09.609400 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bdac1-2c87-4db4-9581-dfbb585af100 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:09.611910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-aa1e9ae1-7ab5-44b6-80bf-e912153fea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:09.689482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:09.711206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 367/732] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:09 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:09.734078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:09.745789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd919-f033-4d76-b287-7f85394a72cb None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.746720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd919-f033-4d76-b287-7f85394a72cb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.747312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd919-f033-4d76-b287-7f85394a72cb None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.749161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 368/733] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:09.750066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdd919-f033-4d76-b287-7f85394a72cb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:09.808641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bdac1-2c87-4db4-9581-dfbb585af100 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:09.845982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953964bc-9c00-40bd-94a2-684203198f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:09.846673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953964bc-9c00-40bd-94a2-684203198f7e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.846960 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953964bc-9c00-40bd-94a2-684203198f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.847242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953964bc-9c00-40bd-94a2-684203198f7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.879471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdd919-f033-4d76-b287-7f85394a72cb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:09.924081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953964bc-9c00-40bd-94a2-684203198f7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:09.925245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4abbe-2d55-40b0-a2b8-5eb7e03ca35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:09.925677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953964bc-9c00-40bd-94a2-684203198f7e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:09.926547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4abbe-2d55-40b0-a2b8-5eb7e03ca35b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.927032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4abbe-2d55-40b0-a2b8-5eb7e03ca35b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.927764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4abbe-2d55-40b0-a2b8-5eb7e03ca35b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.941992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4abbe-2d55-40b0-a2b8-5eb7e03ca35b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-16f4abbe-2d55-40b0-a2b8-5eb7e03ca35b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:09.950151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:09.951127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:09.952607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 369/734] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:09.953301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa275b7-3229-43cc-ad78-bb43bafc6a54 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:09.953301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa275b7-3229-43cc-ad78-bb43bafc6a54 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:09.953619 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa275b7-3229-43cc-ad78-bb43bafc6a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:09.971339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ffa275b7-3229-43cc-ad78-bb43bafc6a54 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:09.972455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ffa275b7-3229-43cc-ad78-bb43bafc6a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:09.984411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:10.030645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:10.050162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 366/735] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:09 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:10.051431 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953964bc-9c00-40bd-94a2-684203198f7e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:10.062829 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 370/736] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:09 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:10.064385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9232-f78a-4d69-99bb-1a9b526abeb1 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.064677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9232-f78a-4d69-99bb-1a9b526abeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.064958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9232-f78a-4d69-99bb-1a9b526abeb1 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.066347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 371/737] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:10.066957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f9232-f78a-4d69-99bb-1a9b526abeb1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:10.167370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953964bc-9c00-40bd-94a2-684203198f7e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:10.173526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f9232-f78a-4d69-99bb-1a9b526abeb1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:10.204312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a6a81-d878-4b04-93f3-b28357f7c17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:10.205007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a6a81-d878-4b04-93f3-b28357f7c17b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.205296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a6a81-d878-4b04-93f3-b28357f7c17b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.205576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a6a81-d878-4b04-93f3-b28357f7c17b None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.206328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a6a81-d878-4b04-93f3-b28357f7c17b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:10.206680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a6a81-d878-4b04-93f3-b28357f7c17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:10.208042 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a6a81-d878-4b04-93f3-b28357f7c17b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:10.211092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3f4f5-31df-4ff3-bfdb-a7731b75f626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:10.212627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3f4f5-31df-4ff3-bfdb-a7731b75f626 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.213115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3f4f5-31df-4ff3-bfdb-a7731b75f626 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.213704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3f4f5-31df-4ff3-bfdb-a7731b75f626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.216843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 367/738] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:10.218197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023f7be-db30-4dc3-a8e0-942a3fc57efc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.218679 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023f7be-db30-4dc3-a8e0-942a3fc57efc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.219128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023f7be-db30-4dc3-a8e0-942a3fc57efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.225858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3f4f5-31df-4ff3-bfdb-a7731b75f626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:10.227347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3f4f5-31df-4ff3-bfdb-a7731b75f626 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:10.240755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6023f7be-db30-4dc3-a8e0-942a3fc57efc None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:10.242449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6023f7be-db30-4dc3-a8e0-942a3fc57efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:10.244589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-34e3f4f5-31df-4ff3-bfdb-a7731b75f626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:10.248899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:10.250589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:10.253052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:10.253052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:10.253052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:10.253052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:10.254792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 372/739] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:10.255721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3f4f5-31df-4ff3-bfdb-a7731b75f626 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:10.287401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:10.322005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 368/740] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:10 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:10.326621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023f7be-db30-4dc3-a8e0-942a3fc57efc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:10.368831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3f4f5-31df-4ff3-bfdb-a7731b75f626 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:10.407071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af222f-f10e-4072-bcb9-ec6cbbd615c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:10.407875 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af222f-f10e-4072-bcb9-ec6cbbd615c6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.408160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af222f-f10e-4072-bcb9-ec6cbbd615c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.408435 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af222f-f10e-4072-bcb9-ec6cbbd615c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.420538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af222f-f10e-4072-bcb9-ec6cbbd615c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-74af222f-f10e-4072-bcb9-ec6cbbd615c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:10.428454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:10.429573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:10.430572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 373/741] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:20:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:10.431385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af222f-f10e-4072-bcb9-ec6cbbd615c6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:10.439069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023f7be-db30-4dc3-a8e0-942a3fc57efc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:10.482448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec163c72-94b2-4201-b38d-7e4b143ab4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:10.483231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec163c72-94b2-4201-b38d-7e4b143ab4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.483521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec163c72-94b2-4201-b38d-7e4b143ab4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.483796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec163c72-94b2-4201-b38d-7e4b143ab4a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.490321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:10.494991 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec163c72-94b2-4201-b38d-7e4b143ab4a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:10.496371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec163c72-94b2-4201-b38d-7e4b143ab4a1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-ec163c72-94b2-4201-b38d-7e4b143ab4a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:10.514456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:10.515535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:10.522114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:10.522114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:10.522114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:10.522114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:10.522114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 369/742] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:10.522114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec163c72-94b2-4201-b38d-7e4b143ab4a1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:10.539813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:10.550444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af222f-f10e-4072-bcb9-ec6cbbd615c6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:10.595474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263dbe0-de2f-4efc-8ac1-7df4af7a2372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:10.596379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263dbe0-de2f-4efc-8ac1-7df4af7a2372 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.596675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263dbe0-de2f-4efc-8ac1-7df4af7a2372 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.597781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263dbe0-de2f-4efc-8ac1-7df4af7a2372 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.598757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263dbe0-de2f-4efc-8ac1-7df4af7a2372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:10.598875 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263dbe0-de2f-4efc-8ac1-7df4af7a2372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:10.600224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263dbe0-de2f-4efc-8ac1-7df4af7a2372 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:10.620616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 374/743] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:10.620616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263dbe0-de2f-4efc-8ac1-7df4af7a2372 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:10.628080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec163c72-94b2-4201-b38d-7e4b143ab4a1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:10.664252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68060136-be8e-45e9-9d24-a55d6bf402de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:10.664920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68060136-be8e-45e9-9d24-a55d6bf402de None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.665235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68060136-be8e-45e9-9d24-a55d6bf402de None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.665515 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68060136-be8e-45e9-9d24-a55d6bf402de None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.666244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68060136-be8e-45e9-9d24-a55d6bf402de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:10.667656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68060136-be8e-45e9-9d24-a55d6bf402de None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:10.682403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 370/744] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:20:10 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:10.683226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68060136-be8e-45e9-9d24-a55d6bf402de None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:10.746190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263dbe0-de2f-4efc-8ac1-7df4af7a2372 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:10.767036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:10.788159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca0ee-e65f-437a-bf04-714732a82314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:10.788866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca0ee-e65f-437a-bf04-714732a82314 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.789142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca0ee-e65f-437a-bf04-714732a82314 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.789421 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca0ee-e65f-437a-bf04-714732a82314 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.790326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faca0ee-e65f-437a-bf04-714732a82314 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:10.790695 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faca0ee-e65f-437a-bf04-714732a82314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:10.792204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faca0ee-e65f-437a-bf04-714732a82314 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:10.806024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 375/745] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:20:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:10.807386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca0ee-e65f-437a-bf04-714732a82314 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:10.823070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:10.838499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68060136-be8e-45e9-9d24-a55d6bf402de None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:10.886291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c072f6-bf34-48a4-9004-5449bbe2f3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:10.887758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c072f6-bf34-48a4-9004-5449bbe2f3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.887758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c072f6-bf34-48a4-9004-5449bbe2f3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.887758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c072f6-bf34-48a4-9004-5449bbe2f3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.888726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c072f6-bf34-48a4-9004-5449bbe2f3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:10.888726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c072f6-bf34-48a4-9004-5449bbe2f3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:10.890119 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c072f6-bf34-48a4-9004-5449bbe2f3c3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:10.906132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 371/746] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:10.907103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c072f6-bf34-48a4-9004-5449bbe2f3c3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:10.933555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca0ee-e65f-437a-bf04-714732a82314 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:10.975357 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb9d1e-bb9b-4442-a622-2cc4fa3eb4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:10.977181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb9d1e-bb9b-4442-a622-2cc4fa3eb4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:10.977472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb9d1e-bb9b-4442-a622-2cc4fa3eb4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:10.977824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb9d1e-bb9b-4442-a622-2cc4fa3eb4b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:10.989153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb9d1e-bb9b-4442-a622-2cc4fa3eb4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:10.991657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb9d1e-bb9b-4442-a622-2cc4fa3eb4b5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-63fb9d1e-bb9b-4442-a622-2cc4fa3eb4b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:11.012686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:11.013654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:11.014675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:11.014675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:11.014675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:11.014675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:11.014675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:11.014675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:11.014675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:11.014675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:11.015135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 376/747] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:11.015691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb9d1e-bb9b-4442-a622-2cc4fa3eb4b5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:11.030930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c072f6-bf34-48a4-9004-5449bbe2f3c3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:11.042506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:11.072170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43450f-6f0e-4a4f-bf12-279c126a3d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:11.073064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43450f-6f0e-4a4f-bf12-279c126a3d1a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.073715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43450f-6f0e-4a4f-bf12-279c126a3d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.074054 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43450f-6f0e-4a4f-bf12-279c126a3d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.088076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43450f-6f0e-4a4f-bf12-279c126a3d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:11.089798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43450f-6f0e-4a4f-bf12-279c126a3d1a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:11.098420 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-ac43450f-6f0e-4a4f-bf12-279c126a3d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:11.112696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:11.113646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:11.114970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:11.114970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:11.114970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:11.114970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:11.118718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 372/748] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:11.119812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43450f-6f0e-4a4f-bf12-279c126a3d1a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:11.148370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb9d1e-bb9b-4442-a622-2cc4fa3eb4b5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:11.185299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdece7e-d21a-4be8-ae56-a95f2a125a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:11.186142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdece7e-d21a-4be8-ae56-a95f2a125a7c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.186449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdece7e-d21a-4be8-ae56-a95f2a125a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.186884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdece7e-d21a-4be8-ae56-a95f2a125a7c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.196321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdece7e-d21a-4be8-ae56-a95f2a125a7c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:11.198977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdece7e-d21a-4be8-ae56-a95f2a125a7c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1cdece7e-d21a-4be8-ae56-a95f2a125a7c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:11.216912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:11.217907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 377/749] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Jun 24 10:20:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:11.223475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdece7e-d21a-4be8-ae56-a95f2a125a7c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:11.254806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43450f-6f0e-4a4f-bf12-279c126a3d1a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:11.296978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb5f5d-433e-42ad-b6c9-067259c3417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:11.297755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb5f5d-433e-42ad-b6c9-067259c3417c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.298039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb5f5d-433e-42ad-b6c9-067259c3417c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.298600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb5f5d-433e-42ad-b6c9-067259c3417c None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.299594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb5f5d-433e-42ad-b6c9-067259c3417c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:11.299913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb5f5d-433e-42ad-b6c9-067259c3417c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:11.301344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb5f5d-433e-42ad-b6c9-067259c3417c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:11.320701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 373/750] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:11.321664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb5f5d-433e-42ad-b6c9-067259c3417c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:11.348425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:11.353335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdece7e-d21a-4be8-ae56-a95f2a125a7c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:11.383070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:11.391955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc267c-f060-4837-b65c-61823040d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:11.392918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc267c-f060-4837-b65c-61823040d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.393267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc267c-f060-4837-b65c-61823040d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.393642 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc267c-f060-4837-b65c-61823040d0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.394500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc267c-f060-4837-b65c-61823040d0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:11.394910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc267c-f060-4837-b65c-61823040d0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:11.396499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc267c-f060-4837-b65c-61823040d0d6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:11.413246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 378/751] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:11.414418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc267c-f060-4837-b65c-61823040d0d6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:11.435671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb5f5d-433e-42ad-b6c9-067259c3417c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:11.472146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8620d-3014-4889-b469-9bce5d98d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:11.473261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8620d-3014-4889-b469-9bce5d98d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.473799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8620d-3014-4889-b469-9bce5d98d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.474297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8620d-3014-4889-b469-9bce5d98d3f4 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.475373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8620d-3014-4889-b469-9bce5d98d3f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:11.475983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8620d-3014-4889-b469-9bce5d98d3f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:11.478258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8620d-3014-4889-b469-9bce5d98d3f4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:11.498552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 374/752] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Jun 24 10:20:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:11.499704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8620d-3014-4889-b469-9bce5d98d3f4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:11.529609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc267c-f060-4837-b65c-61823040d0d6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:11.569570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395aed5e-c893-48f5-a937-ec11c2665eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:11.569570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aed5e-c893-48f5-a937-ec11c2665eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.569570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aed5e-c893-48f5-a937-ec11c2665eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.569570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aed5e-c893-48f5-a937-ec11c2665eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.569969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395aed5e-c893-48f5-a937-ec11c2665eb6 None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=67ae1a0fbb4f44e6b60281ce63dc68fe) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:11.569969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395aed5e-c893-48f5-a937-ec11c2665eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:11.571991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395aed5e-c893-48f5-a937-ec11c2665eb6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:11.582522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 379/753] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:11 2022] GET /identity/v3/role_assignments?user.id=67ae1a0fbb4f44e6b60281ce63dc68fe&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:11.583614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395aed5e-c893-48f5-a937-ec11c2665eb6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:11.607282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:11.628196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8620d-3014-4889-b469-9bce5d98d3f4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:11.666864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b038-7019-434a-bc9f-dbc529c1a169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:11.668143 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b038-7019-434a-bc9f-dbc529c1a169 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.668709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b038-7019-434a-bc9f-dbc529c1a169 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.669253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b038-7019-434a-bc9f-dbc529c1a169 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.677444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10b038-7019-434a-bc9f-dbc529c1a169 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:11.679468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10b038-7019-434a-bc9f-dbc529c1a169 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:11.687743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7e10b038-7019-434a-bc9f-dbc529c1a169 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:11.699140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:11.700171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:11.701109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:11.701109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:11.701109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:11.701109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:11.701109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:11.701109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:11.701109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:11.701109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:11.701109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:11.701109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:11.704011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 375/754] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Jun 24 10:20:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:11.728014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b038-7019-434a-bc9f-dbc529c1a169 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:11.756514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395aed5e-c893-48f5-a937-ec11c2665eb6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:11.793311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01997d1a-147b-48b1-8280-dc489f882379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:11.794111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997d1a-147b-48b1-8280-dc489f882379 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.794421 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997d1a-147b-48b1-8280-dc489f882379 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.794770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997d1a-147b-48b1-8280-dc489f882379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.807455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01997d1a-147b-48b1-8280-dc489f882379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:11.809009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01997d1a-147b-48b1-8280-dc489f882379 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-01997d1a-147b-48b1-8280-dc489f882379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:11.828463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:11.829375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:11.830338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:11.830338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:11.830338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:11.830338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:11.834164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 380/755] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:11.835557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff7bb6-74d0-43d9-b708-016c651841f2 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.835886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff7bb6-74d0-43d9-b708-016c651841f2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.836133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff7bb6-74d0-43d9-b708-016c651841f2 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.838186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 381/756] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:11.838952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff7bb6-74d0-43d9-b708-016c651841f2 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:11.850486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b038-7019-434a-bc9f-dbc529c1a169 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:11.889127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edb3e1-c6a4-440d-89c7-1c29dd8dbdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:11.890274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb3e1-c6a4-440d-89c7-1c29dd8dbdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.890736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb3e1-c6a4-440d-89c7-1c29dd8dbdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.891143 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edb3e1-c6a4-440d-89c7-1c29dd8dbdd9 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.892250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edb3e1-c6a4-440d-89c7-1c29dd8dbdd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:11.892569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edb3e1-c6a4-440d-89c7-1c29dd8dbdd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:11.894684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edb3e1-c6a4-440d-89c7-1c29dd8dbdd9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:11.905910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:11.920336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 376/757] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Jun 24 10:20:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:11.922236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f3c49-2956-41f3-becf-f376427fa0cf None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.922804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f3c49-2956-41f3-becf-f376427fa0cf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.923585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f3c49-2956-41f3-becf-f376427fa0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.942919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-cc3f3c49-2956-41f3-becf-f376427fa0cf None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:11.944524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cc3f3c49-2956-41f3-becf-f376427fa0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:11.953689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff7bb6-74d0-43d9-b708-016c651841f2 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:11.956969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:11.992070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb94e7-1083-4b8e-bebe-b66ab01f3f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:11.992731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb94e7-1083-4b8e-bebe-b66ab01f3f64 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:11.993013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb94e7-1083-4b8e-bebe-b66ab01f3f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:11.994196 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb94e7-1083-4b8e-bebe-b66ab01f3f64 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:11.995004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb94e7-1083-4b8e-bebe-b66ab01f3f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:11.995315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb94e7-1083-4b8e-bebe-b66ab01f3f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:11.996693 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb94e7-1083-4b8e-bebe-b66ab01f3f64 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:12.014200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 382/758] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:12.014200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb94e7-1083-4b8e-bebe-b66ab01f3f64 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:12.048426 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 377/759] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:12.050876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f3c49-2956-41f3-becf-f376427fa0cf None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:12.132716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb94e7-1083-4b8e-bebe-b66ab01f3f64 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:12.169106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f3c49-2956-41f3-becf-f376427fa0cf None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:12.174092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f55c1b-0560-4b32-8564-41e569e3e3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:12.175018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f55c1b-0560-4b32-8564-41e569e3e3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:12.175535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f55c1b-0560-4b32-8564-41e569e3e3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:12.176012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f55c1b-0560-4b32-8564-41e569e3e3d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:12.197670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:12.207508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d06da6-0eee-483a-b035-097f7959c7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:12.208585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d06da6-0eee-483a-b035-097f7959c7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:12.208877 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d06da6-0eee-483a-b035-097f7959c7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:12.209164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d06da6-0eee-483a-b035-097f7959c7a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:12.211663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:12.219902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d06da6-0eee-483a-b035-097f7959c7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:12.221395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d06da6-0eee-483a-b035-097f7959c7a8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-95d06da6-0eee-483a-b035-097f7959c7a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:12.237913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:12.238849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:12.239750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:12.239750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:12.239750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:12.239750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:12.239750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:12.239750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:12.239750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:12.239750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:12.247145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 378/760] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:12.248278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d06da6-0eee-483a-b035-097f7959c7a8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:12.266945 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f55c1b-0560-4b32-8564-41e569e3e3d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:12.268736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f55c1b-0560-4b32-8564-41e569e3e3d1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:12.377192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d06da6-0eee-483a-b035-097f7959c7a8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:12.410481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 383/761] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:20:12.410481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f55c1b-0560-4b32-8564-41e569e3e3d1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:12.420528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4abbb-f53c-4b2e-8ffe-bdec54fd054b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:12.421538 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4abbb-f53c-4b2e-8ffe-bdec54fd054b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:12.421927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4abbb-f53c-4b2e-8ffe-bdec54fd054b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:12.422307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4abbb-f53c-4b2e-8ffe-bdec54fd054b None admin] PATH_INFO: `/v3/services/network` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:12.423111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4abbb-f53c-4b2e-8ffe-bdec54fd054b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:12.424849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4abbb-f53c-4b2e-8ffe-bdec54fd054b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-5ce4abbb-f53c-4b2e-8ffe-bdec54fd054b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:12.437368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:12.438642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:20:12.439675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:12.446388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 379/762] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:12 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:12.446388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4abbb-f53c-4b2e-8ffe-bdec54fd054b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:12.488659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:12.508553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:12.531950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f55c1b-0560-4b32-8564-41e569e3e3d1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:12.570293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a938df-2eee-4609-9d11-2548ddf56c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:12.571170 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a938df-2eee-4609-9d11-2548ddf56c98 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:12.571572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a938df-2eee-4609-9d11-2548ddf56c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:12.571962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a938df-2eee-4609-9d11-2548ddf56c98 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:12.572561 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4abbb-f53c-4b2e-8ffe-bdec54fd054b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:12.572963 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a938df-2eee-4609-9d11-2548ddf56c98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:12.573570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a938df-2eee-4609-9d11-2548ddf56c98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:12.575284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a938df-2eee-4609-9d11-2548ddf56c98 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:12.593180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 384/763] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:12.594171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a938df-2eee-4609-9d11-2548ddf56c98 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:12.621425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75dda8-8017-4ee1-986f-396016de0c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:12.623045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75dda8-8017-4ee1-986f-396016de0c2b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:12.623586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75dda8-8017-4ee1-986f-396016de0c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:12.624019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75dda8-8017-4ee1-986f-396016de0c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:12.639114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75dda8-8017-4ee1-986f-396016de0c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:12.641649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75dda8-8017-4ee1-986f-396016de0c2b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-8a75dda8-8017-4ee1-986f-396016de0c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:12.666162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:12.667273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:12.668395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:12.668395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:12.668395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:12.668395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:12.671125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 380/764] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:12.672091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75dda8-8017-4ee1-986f-396016de0c2b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:12.721476 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a938df-2eee-4609-9d11-2548ddf56c98 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:12.754848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:12.769915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae66430-b8ab-40d0-a859-87d5b1f27bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:12.771103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66430-b8ab-40d0-a859-87d5b1f27bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:12.771562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66430-b8ab-40d0-a859-87d5b1f27bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:12.772456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66430-b8ab-40d0-a859-87d5b1f27bb3 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:12.773736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae66430-b8ab-40d0-a859-87d5b1f27bb3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:12.774200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae66430-b8ab-40d0-a859-87d5b1f27bb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:12.776927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae66430-b8ab-40d0-a859-87d5b1f27bb3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:12.787637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 385/765] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:12.787637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae66430-b8ab-40d0-a859-87d5b1f27bb3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:12.797692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75dda8-8017-4ee1-986f-396016de0c2b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:12.801480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:12.848479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22c032-0be7-4a02-b800-4011afc55f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:12.849427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c032-0be7-4a02-b800-4011afc55f41 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:12.849721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c032-0be7-4a02-b800-4011afc55f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:12.849992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c032-0be7-4a02-b800-4011afc55f41 None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/a66ff3915a784ddcb3925aadcb416700/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:12.853236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22c032-0be7-4a02-b800-4011afc55f41 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=a66ff3915a784ddcb3925aadcb416700, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:12.855557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22c032-0be7-4a02-b800-4011afc55f41 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:12.878456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 381/766] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:20:12 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/a66ff3915a784ddcb3925aadcb416700/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:20:12.879445 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22c032-0be7-4a02-b800-4011afc55f41 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:12.909804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae66430-b8ab-40d0-a859-87d5b1f27bb3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:12.953143 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d573040-6e49-422c-8470-a17f09e7ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:12.953742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d573040-6e49-422c-8470-a17f09e7ce44 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:12.954096 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d573040-6e49-422c-8470-a17f09e7ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:12.954375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d573040-6e49-422c-8470-a17f09e7ce44 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:12.955179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d573040-6e49-422c-8470-a17f09e7ce44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:12.955495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d573040-6e49-422c-8470-a17f09e7ce44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:12.957254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d573040-6e49-422c-8470-a17f09e7ce44 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:12.972568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 386/767] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:12.973935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21cfa-7a53-4637-8658-68f80a418bb1 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:12.974222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21cfa-7a53-4637-8658-68f80a418bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:12.974523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21cfa-7a53-4637-8658-68f80a418bb1 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:12.979933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 387/768] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:12.979933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c21cfa-7a53-4637-8658-68f80a418bb1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:13.022927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22c032-0be7-4a02-b800-4011afc55f41 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:13.056890 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:13.068746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ffee5-92e9-4567-802f-322e35974d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:13.069421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ffee5-92e9-4567-802f-322e35974d79 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.069710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ffee5-92e9-4567-802f-322e35974d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.069992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ffee5-92e9-4567-802f-322e35974d79 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.070738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ffee5-92e9-4567-802f-322e35974d79 None admin] RBAC: Adding query filter params (type=network) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:13.071041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ffee5-92e9-4567-802f-322e35974d79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:13.073317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ffee5-92e9-4567-802f-322e35974d79 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:13.079002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 382/769] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:13.080240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32a399-5339-4749-9e4f-8ebf8aefa255 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.080536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32a399-5339-4749-9e4f-8ebf8aefa255 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.080818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32a399-5339-4749-9e4f-8ebf8aefa255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.097913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-aa32a399-5339-4749-9e4f-8ebf8aefa255 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:13.099140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-aa32a399-5339-4749-9e4f-8ebf8aefa255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:13.123084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c21cfa-7a53-4637-8658-68f80a418bb1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:13.126694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:13.166843 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877fd0f-4020-4218-b57b-24e002ebac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:13.167645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877fd0f-4020-4218-b57b-24e002ebac74 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.167956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877fd0f-4020-4218-b57b-24e002ebac74 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.168308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877fd0f-4020-4218-b57b-24e002ebac74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.176279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877fd0f-4020-4218-b57b-24e002ebac74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:13.177741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877fd0f-4020-4218-b57b-24e002ebac74 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:13.182013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 383/770] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:13.182997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32a399-5339-4749-9e4f-8ebf8aefa255 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a877fd0f-4020-4218-b57b-24e002ebac74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:13.192664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:13.193572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:13.194645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:13.194645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:13.194645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:13.194645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:13.194645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:13.194645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:13.194645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:13.194645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:13.194645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 388/771] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:13.201313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877fd0f-4020-4218-b57b-24e002ebac74 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:13.296676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32a399-5339-4749-9e4f-8ebf8aefa255 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:13.322880 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877fd0f-4020-4218-b57b-24e002ebac74 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:13.332757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:13.336402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c74c30-56f2-4cb5-a3ee-c98626271f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:13.337393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74c30-56f2-4cb5-a3ee-c98626271f70 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.337896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74c30-56f2-4cb5-a3ee-c98626271f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.338473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74c30-56f2-4cb5-a3ee-c98626271f70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.339489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c74c30-56f2-4cb5-a3ee-c98626271f70 None admin] RBAC: Adding query filter params (interface=public, service_id=378779c0d71a4e8cb6b142026e3e4c88, region_id=RegionOne) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:13.340028 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c74c30-56f2-4cb5-a3ee-c98626271f70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:13.341604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c74c30-56f2-4cb5-a3ee-c98626271f70 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:13.354022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 384/772] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Jun 24 10:20:13 2022] GET /identity/v3/endpoints?service_id=378779c0d71a4e8cb6b142026e3e4c88&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:13.355291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c74c30-56f2-4cb5-a3ee-c98626271f70 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:13.363963 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ae127-c185-495f-837d-f5c1698ebc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:13.365115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae127-c185-495f-837d-f5c1698ebc58 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.365115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae127-c185-495f-837d-f5c1698ebc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.365291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae127-c185-495f-837d-f5c1698ebc58 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.366045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ae127-c185-495f-837d-f5c1698ebc58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:13.366403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ae127-c185-495f-837d-f5c1698ebc58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:13.368743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ae127-c185-495f-837d-f5c1698ebc58 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:13.382421 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 389/773] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:13.383231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:13.384244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ae127-c185-495f-837d-f5c1698ebc58 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:13.462931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c74c30-56f2-4cb5-a3ee-c98626271f70 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:13.489920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ae127-c185-495f-837d-f5c1698ebc58 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:13.499788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ed609-1c9b-4bc7-866d-b205390b702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:13.500899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ed609-1c9b-4bc7-866d-b205390b702e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.501579 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ed609-1c9b-4bc7-866d-b205390b702e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.502072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ed609-1c9b-4bc7-866d-b205390b702e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.503090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ed609-1c9b-4bc7-866d-b205390b702e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:13.504672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ed609-1c9b-4bc7-866d-b205390b702e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4e3ed609-1c9b-4bc7-866d-b205390b702e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:13.517388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:13.518389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:20:13.519249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:13.523304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 385/774] 10.222.0.44 () {56 vars in 1129 bytes} [Fri Jun 24 10:20:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:13.524365 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ed609-1c9b-4bc7-866d-b205390b702e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:13.527320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8e01c-9d4c-4f04-92a1-db603500a9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:13.529076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e01c-9d4c-4f04-92a1-db603500a9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.529076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e01c-9d4c-4f04-92a1-db603500a9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.529076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8e01c-9d4c-4f04-92a1-db603500a9c7 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.529648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8e01c-9d4c-4f04-92a1-db603500a9c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:13.531039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8e01c-9d4c-4f04-92a1-db603500a9c7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:13.536868 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 390/775] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Jun 24 10:20:13 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:13.542432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8e01c-9d4c-4f04-92a1-db603500a9c7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:13.584838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:13.661865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8e01c-9d4c-4f04-92a1-db603500a9c7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:13.685603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:13.703319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e0b16-df84-4553-9fca-64f8478fc0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:13.704512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e0b16-df84-4553-9fca-64f8478fc0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.705137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e0b16-df84-4553-9fca-64f8478fc0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.705616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e0b16-df84-4553-9fca-64f8478fc0a5 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.706564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e0b16-df84-4553-9fca-64f8478fc0a5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:13.707135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e0b16-df84-4553-9fca-64f8478fc0a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:13.708803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e0b16-df84-4553-9fca-64f8478fc0a5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:13.715505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 391/776] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Jun 24 10:20:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:13.716550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ed609-1c9b-4bc7-866d-b205390b702e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:13.720545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e0b16-df84-4553-9fca-64f8478fc0a5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:13.761872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3717-16da-4374-8ebf-e0671cf86eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:13.762564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3717-16da-4374-8ebf-e0671cf86eed None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.762852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3717-16da-4374-8ebf-e0671cf86eed None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.763131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3717-16da-4374-8ebf-e0671cf86eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.763975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3717-16da-4374-8ebf-e0671cf86eed None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=f75e1cb00d8b44988b660c753d498f77) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:13.764298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3717-16da-4374-8ebf-e0671cf86eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:13.765739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3717-16da-4374-8ebf-e0671cf86eed None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:13.772001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 386/777] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:13 2022] GET /identity/v3/role_assignments?user.id=f75e1cb00d8b44988b660c753d498f77&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:13.840772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:13.847500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e0b16-df84-4553-9fca-64f8478fc0a5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:13.876480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4cc8b-32d5-4ebe-9550-911b4b1f8992 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.876790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4cc8b-32d5-4ebe-9550-911b4b1f8992 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.877050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4cc8b-32d5-4ebe-9550-911b4b1f8992 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.882515 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 387/778] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:13.885282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157f944-bbb4-4b66-b05a-104bfb545114 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.885531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157f944-bbb4-4b66-b05a-104bfb545114 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.885817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157f944-bbb4-4b66-b05a-104bfb545114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.891739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192c1d4-35ed-4532-b74a-a332c4655b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:13.893400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192c1d4-35ed-4532-b74a-a332c4655b98 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:13.893695 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192c1d4-35ed-4532-b74a-a332c4655b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:13.893981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192c1d4-35ed-4532-b74a-a332c4655b98 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:13.894751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192c1d4-35ed-4532-b74a-a332c4655b98 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:13.895068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192c1d4-35ed-4532-b74a-a332c4655b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:13.896491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192c1d4-35ed-4532-b74a-a332c4655b98 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:13.904837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4157f944-bbb4-4b66-b05a-104bfb545114 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:13.906165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4157f944-bbb4-4b66-b05a-104bfb545114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:13.909898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 392/779] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Jun 24 10:20:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:13.911834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192c1d4-35ed-4532-b74a-a332c4655b98 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:13.996356 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 388/780] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:14.021403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157f944-bbb4-4b66-b05a-104bfb545114 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:14.069115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192c1d4-35ed-4532-b74a-a332c4655b98 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:14.114499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59e3a0-28f5-444e-b42b-26133275e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:14.115567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e3a0-28f5-444e-b42b-26133275e6ad None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:14.116045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e3a0-28f5-444e-b42b-26133275e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:14.116519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59e3a0-28f5-444e-b42b-26133275e6ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:14.117515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59e3a0-28f5-444e-b42b-26133275e6ad None admin] RBAC: Adding query filter params (interface=public, service_id=2981b1bc1ff24009ba3c01a7bdf26fa5, region_id=RegionOne) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:14.118611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59e3a0-28f5-444e-b42b-26133275e6ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:14.120230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59e3a0-28f5-444e-b42b-26133275e6ad None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:14.129853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 393/781] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Jun 24 10:20:13 2022] GET /identity/v3/endpoints?service_id=2981b1bc1ff24009ba3c01a7bdf26fa5&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:14.135645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59e3a0-28f5-444e-b42b-26133275e6ad None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:14.167941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:14.185113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:14.210109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157f944-bbb4-4b66-b05a-104bfb545114 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:14.276759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d63bed-062b-4f26-85f6-63db2355dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:14.278011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d63bed-062b-4f26-85f6-63db2355dcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:14.278528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d63bed-062b-4f26-85f6-63db2355dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:14.279029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d63bed-062b-4f26-85f6-63db2355dcd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:14.299556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d63bed-062b-4f26-85f6-63db2355dcd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-e6d63bed-062b-4f26-85f6-63db2355dcd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:14.311339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:14.312279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:14.313116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:14.317885 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 389/782] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:14.323743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d63bed-062b-4f26-85f6-63db2355dcd1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:14.331882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59e3a0-28f5-444e-b42b-26133275e6ad None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:14.392781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc653706-425b-43d7-95cc-3c65c3ae803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:14.393804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc653706-425b-43d7-95cc-3c65c3ae803d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:14.394299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc653706-425b-43d7-95cc-3c65c3ae803d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:14.394824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc653706-425b-43d7-95cc-3c65c3ae803d None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:14.395717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc653706-425b-43d7-95cc-3c65c3ae803d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:14.397341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc653706-425b-43d7-95cc-3c65c3ae803d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:14.403269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 394/783] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Jun 24 10:20:14 2022] GET /identity/v3/services => generated 772 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:14.458057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d63bed-062b-4f26-85f6-63db2355dcd1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:14.495559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783c90c-19ff-4f2c-a56c-8e575d74b5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:14.496594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783c90c-19ff-4f2c-a56c-8e575d74b5da None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:14.497110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783c90c-19ff-4f2c-a56c-8e575d74b5da None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:14.497605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783c90c-19ff-4f2c-a56c-8e575d74b5da None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:14.498607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783c90c-19ff-4f2c-a56c-8e575d74b5da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:14.499126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783c90c-19ff-4f2c-a56c-8e575d74b5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:14.500804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783c90c-19ff-4f2c-a56c-8e575d74b5da None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:14.511266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 390/784] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:14.519376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc653706-425b-43d7-95cc-3c65c3ae803d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:14.673404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:14.687890 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc653706-425b-43d7-95cc-3c65c3ae803d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:14.731941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c0d54-a274-422a-9d25-0eeabebf69cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:14.732748 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0d54-a274-422a-9d25-0eeabebf69cb None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:14.733036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0d54-a274-422a-9d25-0eeabebf69cb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:14.733314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0d54-a274-422a-9d25-0eeabebf69cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:14.748051 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c0d54-a274-422a-9d25-0eeabebf69cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:14.749660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c0d54-a274-422a-9d25-0eeabebf69cb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-af8c0d54-a274-422a-9d25-0eeabebf69cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:14.773186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:14.774190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:14.775134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:14.775134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:14.775134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:14.775134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:14.775134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 395/785] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:14.784623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783c90c-19ff-4f2c-a56c-8e575d74b5da None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:14.787717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:14.909450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783c90c-19ff-4f2c-a56c-8e575d74b5da None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:14.951068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91d100-1798-400e-860e-752fcea54672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:14.951709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d100-1798-400e-860e-752fcea54672 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:14.952048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d100-1798-400e-860e-752fcea54672 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:14.952334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d100-1798-400e-860e-752fcea54672 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:14.953524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91d100-1798-400e-860e-752fcea54672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:14.954098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91d100-1798-400e-860e-752fcea54672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:14.955564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91d100-1798-400e-860e-752fcea54672 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:14.970402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 391/786] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:14.979680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c0d54-a274-422a-9d25-0eeabebf69cb None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:15.134404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c0d54-a274-422a-9d25-0eeabebf69cb None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:15.191046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d240a-fdb1-45f4-bfb8-9f5348889867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:15.192224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d240a-fdb1-45f4-bfb8-9f5348889867 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:15.192726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d240a-fdb1-45f4-bfb8-9f5348889867 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:15.193208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d240a-fdb1-45f4-bfb8-9f5348889867 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:15.200491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b0d49-8837-465b-ac2e-222240216767 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:15.200788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b0d49-8837-465b-ac2e-222240216767 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:15.201120 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b0d49-8837-465b-ac2e-222240216767 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:15.202192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d240a-fdb1-45f4-bfb8-9f5348889867 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:15.202687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 392/787] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:15.204243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d240a-fdb1-45f4-bfb8-9f5348889867 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:15.207655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b52cb-f939-4a9a-a27f-42362a8f7d86 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:15.208032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b52cb-f939-4a9a-a27f-42362a8f7d86 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:15.208322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b52cb-f939-4a9a-a27f-42362a8f7d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-3c8d240a-fdb1-45f4-bfb8-9f5348889867 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:15.220927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:15.221877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:15.222841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:15.222841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:15.222841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:15.222841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:15.222841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:15.222841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:15.222841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:15.222841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:15.222841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:20:15.222841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:15.227876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:15.230337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 396/788] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:15.231531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d240a-fdb1-45f4-bfb8-9f5348889867 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:15.252617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1e2b52cb-f939-4a9a-a27f-42362a8f7d86 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:15.253839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1e2b52cb-f939-4a9a-a27f-42362a8f7d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:15.359460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:15.386384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 393/789] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:15.388065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d240a-fdb1-45f4-bfb8-9f5348889867 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:15.423437 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b52cb-f939-4a9a-a27f-42362a8f7d86 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:15.426084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df155ad-cd0a-4d35-94d5-e486ec1168d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:15.430534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df155ad-cd0a-4d35-94d5-e486ec1168d3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:15.430534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df155ad-cd0a-4d35-94d5-e486ec1168d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:15.430534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df155ad-cd0a-4d35-94d5-e486ec1168d3 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:15.430534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df155ad-cd0a-4d35-94d5-e486ec1168d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:15.430534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df155ad-cd0a-4d35-94d5-e486ec1168d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:15.430534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df155ad-cd0a-4d35-94d5-e486ec1168d3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:15.471282 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 397/790] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Jun 24 10:20:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:15.475344 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df155ad-cd0a-4d35-94d5-e486ec1168d3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:15.579011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b52cb-f939-4a9a-a27f-42362a8f7d86 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:15.614970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:15.651090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa56dab-8c4c-43df-9d5d-654f009fca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:15.652291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56dab-8c4c-43df-9d5d-654f009fca08 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:15.652581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56dab-8c4c-43df-9d5d-654f009fca08 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:15.652859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa56dab-8c4c-43df-9d5d-654f009fca08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:15.678401 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa56dab-8c4c-43df-9d5d-654f009fca08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:15.680560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df155ad-cd0a-4d35-94d5-e486ec1168d3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7fa56dab-8c4c-43df-9d5d-654f009fca08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:15.689842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:15.690815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:15.691661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:15.702707 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 394/791] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:15.704972 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa56dab-8c4c-43df-9d5d-654f009fca08 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:15.753643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855714-95ae-4c28-98a9-d73a98a11c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:15.754807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855714-95ae-4c28-98a9-d73a98a11c7a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:15.755291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855714-95ae-4c28-98a9-d73a98a11c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:15.755781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855714-95ae-4c28-98a9-d73a98a11c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:15.780911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855714-95ae-4c28-98a9-d73a98a11c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:15.782729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855714-95ae-4c28-98a9-d73a98a11c7a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:15.806710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-8c855714-95ae-4c28-98a9-d73a98a11c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:15.819486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:15.820467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:15.821977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:15.821977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:15.821977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:15.821977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:15.821977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 398/792] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:15.828630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855714-95ae-4c28-98a9-d73a98a11c7a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:15.894269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa56dab-8c4c-43df-9d5d-654f009fca08 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:15.937182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44e51a-867e-4be6-823f-44fca1e24835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:15.937857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44e51a-867e-4be6-823f-44fca1e24835 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:15.938153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44e51a-867e-4be6-823f-44fca1e24835 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:15.938433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44e51a-867e-4be6-823f-44fca1e24835 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:15.942380 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44e51a-867e-4be6-823f-44fca1e24835 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:15.942380 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44e51a-867e-4be6-823f-44fca1e24835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:15.942380 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44e51a-867e-4be6-823f-44fca1e24835 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:15.951881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 395/793] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:15.959362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44e51a-867e-4be6-823f-44fca1e24835 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:16.024987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855714-95ae-4c28-98a9-d73a98a11c7a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:16.044529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:16.085401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006d79f-71cb-46f1-87ea-85d064268911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:16.087562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006d79f-71cb-46f1-87ea-85d064268911 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.088187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006d79f-71cb-46f1-87ea-85d064268911 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.091202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006d79f-71cb-46f1-87ea-85d064268911 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.092084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006d79f-71cb-46f1-87ea-85d064268911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:16.092558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006d79f-71cb-46f1-87ea-85d064268911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:16.095605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006d79f-71cb-46f1-87ea-85d064268911 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:16.117108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44e51a-867e-4be6-823f-44fca1e24835 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:16.119386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 399/794] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:16.121618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006d79f-71cb-46f1-87ea-85d064268911 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:16.135346 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:16.167904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6e449-e92f-4dd0-a988-a0f42cae95d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:16.168954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6e449-e92f-4dd0-a988-a0f42cae95d8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.169254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6e449-e92f-4dd0-a988-a0f42cae95d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.169631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6e449-e92f-4dd0-a988-a0f42cae95d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.183095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6e449-e92f-4dd0-a988-a0f42cae95d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:16.184740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6e449-e92f-4dd0-a988-a0f42cae95d8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-ebc6e449-e92f-4dd0-a988-a0f42cae95d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:16.203412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:16.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:16.205670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:16.205670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:16.205670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:16.205670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:16.207086 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 396/795] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:16.208612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d38d68-0258-4bbd-bfe6-98dc6a675f70 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.208974 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d38d68-0258-4bbd-bfe6-98dc6a675f70 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.209316 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d38d68-0258-4bbd-bfe6-98dc6a675f70 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.211006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 397/796] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:16.212354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1917ba-273e-44a6-a033-fa956167ea4e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.212641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1917ba-273e-44a6-a033-fa956167ea4e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.212915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1917ba-273e-44a6-a033-fa956167ea4e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.214230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 398/797] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:16.215573 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1917ba-273e-44a6-a033-fa956167ea4e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:16.251107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006d79f-71cb-46f1-87ea-85d064268911 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:16.287326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025bf02-5577-4a0d-b194-aedd1ed2d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:16.288119 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025bf02-5577-4a0d-b194-aedd1ed2d4ff None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.288401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025bf02-5577-4a0d-b194-aedd1ed2d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.288680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025bf02-5577-4a0d-b194-aedd1ed2d4ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.295968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025bf02-5577-4a0d-b194-aedd1ed2d4ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:16.297439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025bf02-5577-4a0d-b194-aedd1ed2d4ff None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c025bf02-5577-4a0d-b194-aedd1ed2d4ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:16.313208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:16.314109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:16.315060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:16.315060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:16.315060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:16.315060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:16.315060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:16.315060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:16.315060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:16.315060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:16.315060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 400/798] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:16.315557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a07c6d-1cde-450f-8671-f8f508fdd318 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.317126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a07c6d-1cde-450f-8671-f8f508fdd318 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.317126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a07c6d-1cde-450f-8671-f8f508fdd318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.327228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1917ba-273e-44a6-a033-fa956167ea4e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:16.332559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-05a07c6d-1cde-450f-8671-f8f508fdd318 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:16.333744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-05a07c6d-1cde-450f-8671-f8f508fdd318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:16.358508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:16.364273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a60db-212b-470c-8306-3e6edb0e5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:16.364933 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a60db-212b-470c-8306-3e6edb0e5f75 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.365220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a60db-212b-470c-8306-3e6edb0e5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.365491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a60db-212b-470c-8306-3e6edb0e5f75 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.366207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a60db-212b-470c-8306-3e6edb0e5f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:16.366537 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a60db-212b-470c-8306-3e6edb0e5f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:16.368437 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a60db-212b-470c-8306-3e6edb0e5f75 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:16.385053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 399/799] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:16.385053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad8a5-7297-4a78-b1f6-793a88af5a77 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.385053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad8a5-7297-4a78-b1f6-793a88af5a77 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.385053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ad8a5-7297-4a78-b1f6-793a88af5a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.398095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-179ad8a5-7297-4a78-b1f6-793a88af5a77 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:16.399323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-179ad8a5-7297-4a78-b1f6-793a88af5a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:16.410266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 401/800] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:16.411214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a07c6d-1cde-450f-8671-f8f508fdd318 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:16.419786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:16.478386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 400/801] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:16.478386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ad8a5-7297-4a78-b1f6-793a88af5a77 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:16.537541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a07c6d-1cde-450f-8671-f8f508fdd318 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:16.577512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ec2c-0b87-4979-b570-e5727d41c916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:16.578260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ec2c-0b87-4979-b570-e5727d41c916 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.578644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ec2c-0b87-4979-b570-e5727d41c916 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.578924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ec2c-0b87-4979-b570-e5727d41c916 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.579716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8ec2c-0b87-4979-b570-e5727d41c916 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:16.580028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8ec2c-0b87-4979-b570-e5727d41c916 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:16.580850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ad8a5-7297-4a78-b1f6-793a88af5a77 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:16.581471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8ec2c-0b87-4979-b570-e5727d41c916 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:16.594803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 402/802] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:16.595449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ec2c-0b87-4979-b570-e5727d41c916 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:16.617945 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:16.623015 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47439b3-1d39-40e6-9811-24f681e2a8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:16.623816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47439b3-1d39-40e6-9811-24f681e2a8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.624146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47439b3-1d39-40e6-9811-24f681e2a8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.624377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47439b3-1d39-40e6-9811-24f681e2a8a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.632009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47439b3-1d39-40e6-9811-24f681e2a8a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:16.634282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47439b3-1d39-40e6-9811-24f681e2a8a4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d47439b3-1d39-40e6-9811-24f681e2a8a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:16.648739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:16.650328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:16.651313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:16.651313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:16.651313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:16.651313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:16.651313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:16.651313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:16.651313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:16.651313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:16.651313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:16.651313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:16.655156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 401/803] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Jun 24 10:20:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:16.656039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47439b3-1d39-40e6-9811-24f681e2a8a4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:16.673873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:16.704229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ec2c-0b87-4979-b570-e5727d41c916 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:16.738936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784281be-f3a4-4944-af16-c42beee4dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:16.739724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784281be-f3a4-4944-af16-c42beee4dbff None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.740011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784281be-f3a4-4944-af16-c42beee4dbff None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.740288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784281be-f3a4-4944-af16-c42beee4dbff None admin] PATH_INFO: `/v3/services/network` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.740940 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784281be-f3a4-4944-af16-c42beee4dbff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:16.742305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784281be-f3a4-4944-af16-c42beee4dbff None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-784281be-f3a4-4944-af16-c42beee4dbff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:16.754321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:16.755317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 10:20:16.756156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:16.760852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 403/804] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:16 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:16.761672 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784281be-f3a4-4944-af16-c42beee4dbff None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:16.763113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47439b3-1d39-40e6-9811-24f681e2a8a4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:16.801657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0f084-b10e-41d9-8b08-983e43437382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:16.802940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0f084-b10e-41d9-8b08-983e43437382 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.803461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0f084-b10e-41d9-8b08-983e43437382 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.803824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0f084-b10e-41d9-8b08-983e43437382 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.814451 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0f084-b10e-41d9-8b08-983e43437382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-c3f0f084-b10e-41d9-8b08-983e43437382 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:16.822580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:16.823516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:16.824357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 402/805] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:20:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:16.825065 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0f084-b10e-41d9-8b08-983e43437382 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:16.858991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:16.875628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784281be-f3a4-4944-af16-c42beee4dbff None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:16.908446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:16.909233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d653f1-49e3-458c-bed3-6fe77429d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:16.910506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d653f1-49e3-458c-bed3-6fe77429d870 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:16.910791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d653f1-49e3-458c-bed3-6fe77429d870 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:16.911076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d653f1-49e3-458c-bed3-6fe77429d870 None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/67ae1a0fbb4f44e6b60281ce63dc68fe/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:16.913145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d653f1-49e3-458c-bed3-6fe77429d870 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=67ae1a0fbb4f44e6b60281ce63dc68fe, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:16.914646 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d653f1-49e3-458c-bed3-6fe77429d870 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:16.927314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 404/806] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:20:16 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/67ae1a0fbb4f44e6b60281ce63dc68fe/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:20:16.928257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d653f1-49e3-458c-bed3-6fe77429d870 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:16.952158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0f084-b10e-41d9-8b08-983e43437382 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:17.004974 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ed195-7538-46c5-8676-3c88218a2e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:17.006068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed195-7538-46c5-8676-3c88218a2e26 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.006624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed195-7538-46c5-8676-3c88218a2e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.007361 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed195-7538-46c5-8676-3c88218a2e26 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.009753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ed195-7538-46c5-8676-3c88218a2e26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:17.010510 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ed195-7538-46c5-8676-3c88218a2e26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:17.012941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ed195-7538-46c5-8676-3c88218a2e26 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:17.040310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 403/807] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Jun 24 10:20:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:17.041784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ed195-7538-46c5-8676-3c88218a2e26 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:17.065928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d653f1-49e3-458c-bed3-6fe77429d870 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:17.114398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbfff1-d5e1-46cf-94b2-b29cb71fef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:17.114398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbfff1-d5e1-46cf-94b2-b29cb71fef23 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.114398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbfff1-d5e1-46cf-94b2-b29cb71fef23 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.114398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbfff1-d5e1-46cf-94b2-b29cb71fef23 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.114810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbfff1-d5e1-46cf-94b2-b29cb71fef23 None admin] RBAC: Adding query filter params (name=network) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:17.115086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbfff1-d5e1-46cf-94b2-b29cb71fef23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:17.116674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbfff1-d5e1-46cf-94b2-b29cb71fef23 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:17.122116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 405/808] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:17.123198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbfff1-d5e1-46cf-94b2-b29cb71fef23 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:17.137942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:17.174897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ed195-7538-46c5-8676-3c88218a2e26 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:17.211769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b2932-79f6-48c3-aaa6-e598a3fca322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:17.212440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b2932-79f6-48c3-aaa6-e598a3fca322 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.212726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b2932-79f6-48c3-aaa6-e598a3fca322 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.213009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b2932-79f6-48c3-aaa6-e598a3fca322 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.213746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b2932-79f6-48c3-aaa6-e598a3fca322 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:17.214052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b2932-79f6-48c3-aaa6-e598a3fca322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:17.215468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b2932-79f6-48c3-aaa6-e598a3fca322 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:17.216975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:17.224462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 404/809] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:20:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:17.226037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adb9c1-2ef4-4171-9ce2-b423684dfe37 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.226763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adb9c1-2ef4-4171-9ce2-b423684dfe37 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.227044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adb9c1-2ef4-4171-9ce2-b423684dfe37 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.228963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 405/810] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:17.229510 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adb9c1-2ef4-4171-9ce2-b423684dfe37 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:17.237321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbfff1-d5e1-46cf-94b2-b29cb71fef23 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:17.276772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0b5f-2bcc-4574-a21b-8e04b1124a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:17.277426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0b5f-2bcc-4574-a21b-8e04b1124a14 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.277711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0b5f-2bcc-4574-a21b-8e04b1124a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.277984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0b5f-2bcc-4574-a21b-8e04b1124a14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.339087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adb9c1-2ef4-4171-9ce2-b423684dfe37 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:17.347211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b0b5f-2bcc-4574-a21b-8e04b1124a14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:17.348662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b0b5f-2bcc-4574-a21b-8e04b1124a14 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:17.359403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:17.377603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d61f58-7073-47e1-9a5b-ab7c87042f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:17.378269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61f58-7073-47e1-9a5b-ab7c87042f9d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.378582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61f58-7073-47e1-9a5b-ab7c87042f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.378861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61f58-7073-47e1-9a5b-ab7c87042f9d None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.379567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d61f58-7073-47e1-9a5b-ab7c87042f9d None admin] RBAC: Adding query filter params (type=network) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:17.379873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d61f58-7073-47e1-9a5b-ab7c87042f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:17.381224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d61f58-7073-47e1-9a5b-ab7c87042f9d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:17.386484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 406/811] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:17.391702 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d61f58-7073-47e1-9a5b-ab7c87042f9d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:17.456136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:17.460486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 406/812] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:20:17.461781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac22b-cf63-4ac3-9d2b-78653c974583 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.462068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac22b-cf63-4ac3-9d2b-78653c974583 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.462346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac22b-cf63-4ac3-9d2b-78653c974583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.479280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c5fac22b-cf63-4ac3-9d2b-78653c974583 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:17.480456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c5fac22b-cf63-4ac3-9d2b-78653c974583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:17.503975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d61f58-7073-47e1-9a5b-ab7c87042f9d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:17.539053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88e508-656d-44bd-9690-df107a8f69a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:17.540680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e508-656d-44bd-9690-df107a8f69a2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.541061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e508-656d-44bd-9690-df107a8f69a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.541303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e508-656d-44bd-9690-df107a8f69a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.554500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 407/813] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:17.554500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac22b-cf63-4ac3-9d2b-78653c974583 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:17.556227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88e508-656d-44bd-9690-df107a8f69a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:17.557659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88e508-656d-44bd-9690-df107a8f69a2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-fb88e508-656d-44bd-9690-df107a8f69a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:17.587019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:17.588344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:17.589321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:17.589321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:17.589321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:17.589321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:17.590492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 407/814] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:17.592177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88e508-656d-44bd-9690-df107a8f69a2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:17.607650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:17.672287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac22b-cf63-4ac3-9d2b-78653c974583 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:17.692980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88e508-656d-44bd-9690-df107a8f69a2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:17.707167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:17.707822 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4200-7f9f-4e24-acfe-7c5a41ff8605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:17.708493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4200-7f9f-4e24-acfe-7c5a41ff8605 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.708783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4200-7f9f-4e24-acfe-7c5a41ff8605 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.709061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4200-7f9f-4e24-acfe-7c5a41ff8605 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.710171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f4200-7f9f-4e24-acfe-7c5a41ff8605 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:17.712224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f4200-7f9f-4e24-acfe-7c5a41ff8605 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:17.732750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f9af-667e-4831-9c37-fc2e8fd48171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:17.733545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f9af-667e-4831-9c37-fc2e8fd48171 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.742663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f9af-667e-4831-9c37-fc2e8fd48171 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.742891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 408/815] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Jun 24 10:20:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:17.742987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f9af-667e-4831-9c37-fc2e8fd48171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.743090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4200-7f9f-4e24-acfe-7c5a41ff8605 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:17.756177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f9af-667e-4831-9c37-fc2e8fd48171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:17.757860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f9af-667e-4831-9c37-fc2e8fd48171 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3fd2f9af-667e-4831-9c37-fc2e8fd48171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:17.777133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:17.778114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:17.779074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:17.779074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:17.779074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:17.779074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:17.779074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 408/816] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:17.779784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f9af-667e-4831-9c37-fc2e8fd48171 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:17.862712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:17.879655 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4200-7f9f-4e24-acfe-7c5a41ff8605 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:17.915492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f9af-667e-4831-9c37-fc2e8fd48171 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:17.919698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a76c5-49d9-4b47-bf38-ee2a46f3fa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:17.919838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a76c5-49d9-4b47-bf38-ee2a46f3fa01 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.920098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a76c5-49d9-4b47-bf38-ee2a46f3fa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.920444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a76c5-49d9-4b47-bf38-ee2a46f3fa01 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.921241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a76c5-49d9-4b47-bf38-ee2a46f3fa01 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:17.922709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a76c5-49d9-4b47-bf38-ee2a46f3fa01 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-546a76c5-49d9-4b47-bf38-ee2a46f3fa01 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:17.937720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:17.938744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:17.939589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 409/817] 10.222.0.44 () {56 vars in 1129 bytes} [Fri Jun 24 10:20:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:17.940451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a76c5-49d9-4b47-bf38-ee2a46f3fa01 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:17.962087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821bafa-f17c-463e-a1b3-aa972ca743b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:17.962814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821bafa-f17c-463e-a1b3-aa972ca743b8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:17.963098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821bafa-f17c-463e-a1b3-aa972ca743b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:17.963372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821bafa-f17c-463e-a1b3-aa972ca743b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:17.964110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821bafa-f17c-463e-a1b3-aa972ca743b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:17.964402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821bafa-f17c-463e-a1b3-aa972ca743b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:17.965756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821bafa-f17c-463e-a1b3-aa972ca743b8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:17.982852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 409/818] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:17.984047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821bafa-f17c-463e-a1b3-aa972ca743b8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:18.012890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:18.059626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a76c5-49d9-4b47-bf38-ee2a46f3fa01 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:18.098102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94984a0f-6326-425d-8e8d-a8aa78c7d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:18.098803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94984a0f-6326-425d-8e8d-a8aa78c7d638 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:18.099086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94984a0f-6326-425d-8e8d-a8aa78c7d638 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:18.099363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94984a0f-6326-425d-8e8d-a8aa78c7d638 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:18.100086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94984a0f-6326-425d-8e8d-a8aa78c7d638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:18.100392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94984a0f-6326-425d-8e8d-a8aa78c7d638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:18.101747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94984a0f-6326-425d-8e8d-a8aa78c7d638 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:18.104690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821bafa-f17c-463e-a1b3-aa972ca743b8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:18.115649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 410/819] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:18.116410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94984a0f-6326-425d-8e8d-a8aa78c7d638 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:18.135892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:18.143774 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ceb81-397f-4d37-9bc3-0c1b9b05cb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:18.144658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ceb81-397f-4d37-9bc3-0c1b9b05cb94 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:18.145199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ceb81-397f-4d37-9bc3-0c1b9b05cb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:18.145617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ceb81-397f-4d37-9bc3-0c1b9b05cb94 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:18.146590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ceb81-397f-4d37-9bc3-0c1b9b05cb94 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:18.147126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ceb81-397f-4d37-9bc3-0c1b9b05cb94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:18.148849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ceb81-397f-4d37-9bc3-0c1b9b05cb94 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:18.154078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 410/820] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Jun 24 10:20:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:18.154886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ceb81-397f-4d37-9bc3-0c1b9b05cb94 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:18.225828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94984a0f-6326-425d-8e8d-a8aa78c7d638 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:18.246970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:18.260951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ceb81-397f-4d37-9bc3-0c1b9b05cb94 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:18.261100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9242d-bc4c-4861-b43b-233056db1ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:18.261875 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9242d-bc4c-4861-b43b-233056db1ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:18.262161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9242d-bc4c-4861-b43b-233056db1ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:18.262469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9242d-bc4c-4861-b43b-233056db1ca9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:18.271107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9242d-bc4c-4861-b43b-233056db1ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:18.272559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9242d-bc4c-4861-b43b-233056db1ca9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-6fb9242d-bc4c-4861-b43b-233056db1ca9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:18.294092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:18.295273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:18.296197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 411/821] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Jun 24 10:20:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:18.297567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9242d-bc4c-4861-b43b-233056db1ca9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:18.304333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed049-d5d3-4bbf-98a7-9679441ce3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:18.305220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed049-d5d3-4bbf-98a7-9679441ce3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:18.305501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed049-d5d3-4bbf-98a7-9679441ce3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:18.305774 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed049-d5d3-4bbf-98a7-9679441ce3b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:18.314192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed049-d5d3-4bbf-98a7-9679441ce3b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:18.315656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed049-d5d3-4bbf-98a7-9679441ce3b7 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-67eed049-d5d3-4bbf-98a7-9679441ce3b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:18.329614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:18.330530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:18.331434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:18.331434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:18.331434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:18.331434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:18.331434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:18.331434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:18.331434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:18.331434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:18.331434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 411/822] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:18.332639 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed049-d5d3-4bbf-98a7-9679441ce3b7 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:18.389191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:18.414383 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9242d-bc4c-4861-b43b-233056db1ca9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:18.441893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed049-d5d3-4bbf-98a7-9679441ce3b7 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:18.451326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b318b6-9fdd-4588-b4b4-dbac50d636ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:18.451993 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b318b6-9fdd-4588-b4b4-dbac50d636ad None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:18.452272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b318b6-9fdd-4588-b4b4-dbac50d636ad None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:18.452547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b318b6-9fdd-4588-b4b4-dbac50d636ad None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:18.453250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b318b6-9fdd-4588-b4b4-dbac50d636ad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:18.453552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b318b6-9fdd-4588-b4b4-dbac50d636ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:18.454941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b318b6-9fdd-4588-b4b4-dbac50d636ad None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:18.464837 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 412/823] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Jun 24 10:20:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:18.464837 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b318b6-9fdd-4588-b4b4-dbac50d636ad None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:18.476804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f7316-3a11-4a0f-816e-efaa4f22e03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:18.477626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f7316-3a11-4a0f-816e-efaa4f22e03f None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:18.477909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f7316-3a11-4a0f-816e-efaa4f22e03f None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:18.478382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f7316-3a11-4a0f-816e-efaa4f22e03f None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:18.479043 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f7316-3a11-4a0f-816e-efaa4f22e03f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:18.479353 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f7316-3a11-4a0f-816e-efaa4f22e03f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:18.480771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f7316-3a11-4a0f-816e-efaa4f22e03f None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:18.498908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 412/824] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Jun 24 10:20:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:18.499706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f7316-3a11-4a0f-816e-efaa4f22e03f None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:18.509074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:18.593155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b318b6-9fdd-4588-b4b4-dbac50d636ad None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:18.612318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f7316-3a11-4a0f-816e-efaa4f22e03f None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:18.632807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535611f-c5e2-4dc1-b1e6-270093682280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:18.634456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535611f-c5e2-4dc1-b1e6-270093682280 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:18.634797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535611f-c5e2-4dc1-b1e6-270093682280 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:18.635076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535611f-c5e2-4dc1-b1e6-270093682280 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:18.636134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535611f-c5e2-4dc1-b1e6-270093682280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:18.636440 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535611f-c5e2-4dc1-b1e6-270093682280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:18.638628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535611f-c5e2-4dc1-b1e6-270093682280 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:18.645687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:18.649852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff877-51d5-4cf5-98e6-806c76e8cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:18.650546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff877-51d5-4cf5-98e6-806c76e8cd40 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:18.650838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff877-51d5-4cf5-98e6-806c76e8cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:18.651122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff877-51d5-4cf5-98e6-806c76e8cd40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:18.651639 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 413/825] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:18.652550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535611f-c5e2-4dc1-b1e6-270093682280 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:18.657539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fff877-51d5-4cf5-98e6-806c76e8cd40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:18.658966 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fff877-51d5-4cf5-98e6-806c76e8cd40 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:18.683502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 413/826] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Jun 24 10:20:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:18.684432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff877-51d5-4cf5-98e6-806c76e8cd40 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:18.757349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:18.806025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535611f-c5e2-4dc1-b1e6-270093682280 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:18.819224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff877-51d5-4cf5-98e6-806c76e8cd40 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:18.848339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd459f69-83b7-44dd-98b9-ae1fa52075a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:18.849138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd459f69-83b7-44dd-98b9-ae1fa52075a9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:18.849419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd459f69-83b7-44dd-98b9-ae1fa52075a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:18.849693 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd459f69-83b7-44dd-98b9-ae1fa52075a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:18.862668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd459f69-83b7-44dd-98b9-ae1fa52075a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:18.864130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd459f69-83b7-44dd-98b9-ae1fa52075a9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:18.871339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf689-dde7-4b37-8a28-fb78ea57a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:18.872794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf689-dde7-4b37-8a28-fb78ea57a57a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:18.873082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf689-dde7-4b37-8a28-fb78ea57a57a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:18.873361 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf689-dde7-4b37-8a28-fb78ea57a57a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:18.874609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaf689-dde7-4b37-8a28-fb78ea57a57a None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=a66ff3915a784ddcb3925aadcb416700) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:18.875198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaf689-dde7-4b37-8a28-fb78ea57a57a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:18.876636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaf689-dde7-4b37-8a28-fb78ea57a57a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:18.883381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 414/827] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:18 2022] GET /identity/v3/role_assignments?user.id=a66ff3915a784ddcb3925aadcb416700&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-dd459f69-83b7-44dd-98b9-ae1fa52075a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:18.883765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:18.884670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:18.885542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:18.885542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:18.885542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:18.885542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:18.885542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 414/828] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:18.896296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf689-dde7-4b37-8a28-fb78ea57a57a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:19.024153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957e8e-8541-4b0c-bff8-d50f24a48d72 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:19.024520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957e8e-8541-4b0c-bff8-d50f24a48d72 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:19.024731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957e8e-8541-4b0c-bff8-d50f24a48d72 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:19.026597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 415/829] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:19.032431 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728d335-7bb6-4a19-b129-29b21336dec9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:19.032797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728d335-7bb6-4a19-b129-29b21336dec9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:19.033001 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728d335-7bb6-4a19-b129-29b21336dec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:19.053407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a728d335-7bb6-4a19-b129-29b21336dec9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:19.054695 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a728d335-7bb6-4a19-b129-29b21336dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:19.114635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:19.138275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf689-dde7-4b37-8a28-fb78ea57a57a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:19.144977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 416/830] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:19.165355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:19.169903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728d335-7bb6-4a19-b129-29b21336dec9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:19.178582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c4ee-b101-4b10-ae11-ad6dbb086071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:19.179446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c4ee-b101-4b10-ae11-ad6dbb086071 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:19.179883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c4ee-b101-4b10-ae11-ad6dbb086071 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:19.180351 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c4ee-b101-4b10-ae11-ad6dbb086071 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:19.181296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2c4ee-b101-4b10-ae11-ad6dbb086071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:19.181743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2c4ee-b101-4b10-ae11-ad6dbb086071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:19.183278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2c4ee-b101-4b10-ae11-ad6dbb086071 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:19.195556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 415/831] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:19.205765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c4ee-b101-4b10-ae11-ad6dbb086071 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:19.280686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728d335-7bb6-4a19-b129-29b21336dec9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:19.318815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c4ee-b101-4b10-ae11-ad6dbb086071 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:19.320454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4f2bf-9699-4b3e-ad71-a1c817f81bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:19.321456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4f2bf-9699-4b3e-ad71-a1c817f81bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:19.321805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4f2bf-9699-4b3e-ad71-a1c817f81bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:19.322152 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4f2bf-9699-4b3e-ad71-a1c817f81bc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:19.333786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4f2bf-9699-4b3e-ad71-a1c817f81bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-cbf4f2bf-9699-4b3e-ad71-a1c817f81bc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:19.342590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:19.343537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:19.344380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 417/832] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:19.349469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4f2bf-9699-4b3e-ad71-a1c817f81bc7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:19.363463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01eebe-f1f3-44b3-9294-6e4212aba068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:19.364682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01eebe-f1f3-44b3-9294-6e4212aba068 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:19.365172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01eebe-f1f3-44b3-9294-6e4212aba068 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:19.365653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01eebe-f1f3-44b3-9294-6e4212aba068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:19.373337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01eebe-f1f3-44b3-9294-6e4212aba068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:19.375094 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01eebe-f1f3-44b3-9294-6e4212aba068 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7a01eebe-f1f3-44b3-9294-6e4212aba068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:19.390374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:19.391266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:19.392181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:19.392181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:19.392181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:19.392181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:19.392181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:19.392181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:19.392181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:19.392181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:19.394622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 416/833] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:19.397498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:19.401501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01eebe-f1f3-44b3-9294-6e4212aba068 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:19.450022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:19.477994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4f2bf-9699-4b3e-ad71-a1c817f81bc7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:19.522997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01eebe-f1f3-44b3-9294-6e4212aba068 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:19.525211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a0974-a290-4445-b0a9-c334d7301aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:19.526753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a0974-a290-4445-b0a9-c334d7301aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:19.527040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a0974-a290-4445-b0a9-c334d7301aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:19.527318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a0974-a290-4445-b0a9-c334d7301aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:19.528074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a0974-a290-4445-b0a9-c334d7301aa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:19.528385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a0974-a290-4445-b0a9-c334d7301aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:19.529763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a0974-a290-4445-b0a9-c334d7301aa4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:19.543745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 418/834] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:19.544520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a0974-a290-4445-b0a9-c334d7301aa4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:19.576867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d4aef-5cc9-44a7-86e2-7e73876fcf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:19.578105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d4aef-5cc9-44a7-86e2-7e73876fcf49 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:19.578879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d4aef-5cc9-44a7-86e2-7e73876fcf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:19.579393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d4aef-5cc9-44a7-86e2-7e73876fcf49 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:19.580836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d4aef-5cc9-44a7-86e2-7e73876fcf49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:19.581483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d4aef-5cc9-44a7-86e2-7e73876fcf49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:19.583408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d4aef-5cc9-44a7-86e2-7e73876fcf49 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:19.599748 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 417/835] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:19.605071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d4aef-5cc9-44a7-86e2-7e73876fcf49 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:19.666962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a0974-a290-4445-b0a9-c334d7301aa4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:19.669000 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:19.707874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fe792-98f3-44ce-92a4-e3524a9718bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:19.709002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe792-98f3-44ce-92a4-e3524a9718bd None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:19.709486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe792-98f3-44ce-92a4-e3524a9718bd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:19.709977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe792-98f3-44ce-92a4-e3524a9718bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:19.722008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fe792-98f3-44ce-92a4-e3524a9718bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:19.723958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fe792-98f3-44ce-92a4-e3524a9718bd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-458fe792-98f3-44ce-92a4-e3524a9718bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:19.741772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:19.742753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:19.743640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:19.743640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:19.743640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:19.743640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:19.743879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d4aef-5cc9-44a7-86e2-7e73876fcf49 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:19.743879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:19.746377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 419/836] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:19.758653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fe792-98f3-44ce-92a4-e3524a9718bd None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:19.794711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1903ef-cd9e-48fd-bcb3-2c0dbd1655bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:19.795601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1903ef-cd9e-48fd-bcb3-2c0dbd1655bd None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:19.795887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1903ef-cd9e-48fd-bcb3-2c0dbd1655bd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:19.796162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1903ef-cd9e-48fd-bcb3-2c0dbd1655bd None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/f75e1cb00d8b44988b660c753d498f77/roles/d26d3b3eb78246ffb76d8ad95123c66c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:19.816693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1903ef-cd9e-48fd-bcb3-2c0dbd1655bd None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=f75e1cb00d8b44988b660c753d498f77, role_id=d26d3b3eb78246ffb76d8ad95123c66c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:19.819138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1903ef-cd9e-48fd-bcb3-2c0dbd1655bd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:19.846384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 418/837] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:20:19 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/f75e1cb00d8b44988b660c753d498f77/roles/d26d3b3eb78246ffb76d8ad95123c66c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:20:19.885775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fe792-98f3-44ce-92a4-e3524a9718bd None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:19.923224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff83d2-5b36-4ed2-adb9-e296954c32fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:19.923913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff83d2-5b36-4ed2-adb9-e296954c32fa None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:19.924200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff83d2-5b36-4ed2-adb9-e296954c32fa None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:19.924480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff83d2-5b36-4ed2-adb9-e296954c32fa None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:19.925221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff83d2-5b36-4ed2-adb9-e296954c32fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:19.925531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff83d2-5b36-4ed2-adb9-e296954c32fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:19.927024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff83d2-5b36-4ed2-adb9-e296954c32fa None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:19.941933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 420/838] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:19.948128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1903ef-cd9e-48fd-bcb3-2c0dbd1655bd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:20.058605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1903ef-cd9e-48fd-bcb3-2c0dbd1655bd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:20.094645 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5e01-5718-4305-acb4-efabc57c92f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:20.095505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5e01-5718-4305-acb4-efabc57c92f8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:20.095795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5e01-5718-4305-acb4-efabc57c92f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:20.096076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5e01-5718-4305-acb4-efabc57c92f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:20.104623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5e01-5718-4305-acb4-efabc57c92f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:20.106078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5e01-5718-4305-acb4-efabc57c92f8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-111a5e01-5718-4305-acb4-efabc57c92f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:20.121879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:20.122890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:20.124234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 419/839] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:20.129002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff83d2-5b36-4ed2-adb9-e296954c32fa None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:20.146082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:20.234402 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff83d2-5b36-4ed2-adb9-e296954c32fa None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:20.269823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0a18f-f730-439a-8087-9e96c258bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:20.270776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a18f-f730-439a-8087-9e96c258bd33 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:20.271200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a18f-f730-439a-8087-9e96c258bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:20.271618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a18f-f730-439a-8087-9e96c258bd33 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:20.272589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a18f-f730-439a-8087-9e96c258bd33 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:20.273056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a18f-f730-439a-8087-9e96c258bd33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:20.274735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a18f-f730-439a-8087-9e96c258bd33 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:20.294252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 421/840] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Jun 24 10:20:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:20.300013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5e01-5718-4305-acb4-efabc57c92f8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:20.316608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:20.413363 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5e01-5718-4305-acb4-efabc57c92f8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:20.449504 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539be7dd-f971-4bfc-a3e1-c2d7f88f8cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:20.450423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539be7dd-f971-4bfc-a3e1-c2d7f88f8cab None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:20.450848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539be7dd-f971-4bfc-a3e1-c2d7f88f8cab None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:20.451286 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539be7dd-f971-4bfc-a3e1-c2d7f88f8cab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:20.520576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539be7dd-f971-4bfc-a3e1-c2d7f88f8cab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:20.522252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539be7dd-f971-4bfc-a3e1-c2d7f88f8cab None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:20.547110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:20.624780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 420/841] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:20:20.631472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0a18f-f730-439a-8087-9e96c258bd33 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:20.713099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:20.757811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0a18f-f730-439a-8087-9e96c258bd33 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:20.793813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a3713-8b25-4ac0-96df-09b9626a7108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:20.794635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3713-8b25-4ac0-96df-09b9626a7108 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:20.794918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3713-8b25-4ac0-96df-09b9626a7108 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:20.795194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3713-8b25-4ac0-96df-09b9626a7108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:20.806115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a3713-8b25-4ac0-96df-09b9626a7108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:20.807589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a3713-8b25-4ac0-96df-09b9626a7108 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-cd4a3713-8b25-4ac0-96df-09b9626a7108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:20.825077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:20.826029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:20.826951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:20.826951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:20.826951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:20.826951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:20.826951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 422/842] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:20.835471 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539be7dd-f971-4bfc-a3e1-c2d7f88f8cab None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:20.900682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed664d-3037-483d-b33e-43583f746bd7 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:20.900986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed664d-3037-483d-b33e-43583f746bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:20.901232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed664d-3037-483d-b33e-43583f746bd7 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:20.902958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 423/843] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:20.907884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef8d2-e8ce-4f93-947a-6daab406012b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:20.908177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef8d2-e8ce-4f93-947a-6daab406012b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:20.908458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef8d2-e8ce-4f93-947a-6daab406012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:20.930624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-17aef8d2-e8ce-4f93-947a-6daab406012b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:20.931828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-17aef8d2-e8ce-4f93-947a-6daab406012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:20.950443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539be7dd-f971-4bfc-a3e1-c2d7f88f8cab None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:20.965807 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:20.991961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa4f9d-edd1-4d62-8919-209569844f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:20.992666 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa4f9d-edd1-4d62-8919-209569844f41 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:20.992957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa4f9d-edd1-4d62-8919-209569844f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:20.993239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa4f9d-edd1-4d62-8919-209569844f41 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:20.993964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa4f9d-edd1-4d62-8919-209569844f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:20.994276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa4f9d-edd1-4d62-8919-209569844f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:20.995668 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa4f9d-edd1-4d62-8919-209569844f41 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:21.012470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 421/844] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:21.012983 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 424/845] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:21.013912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa4f9d-edd1-4d62-8919-209569844f41 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:21.033008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aef8d2-e8ce-4f93-947a-6daab406012b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:21.095541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:21.134089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa4f9d-edd1-4d62-8919-209569844f41 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:21.146149 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aef8d2-e8ce-4f93-947a-6daab406012b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:21.170435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395897c1-6d23-4802-8604-4355e818076d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:21.171218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395897c1-6d23-4802-8604-4355e818076d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:21.171502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395897c1-6d23-4802-8604-4355e818076d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:21.171776 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395897c1-6d23-4802-8604-4355e818076d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:21.179097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395897c1-6d23-4802-8604-4355e818076d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:21.180594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395897c1-6d23-4802-8604-4355e818076d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:21.186568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2ae09-a97a-41f1-a044-7de3189efe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:21.187361 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2ae09-a97a-41f1-a044-7de3189efe33 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:21.187641 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2ae09-a97a-41f1-a044-7de3189efe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:21.187910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2ae09-a97a-41f1-a044-7de3189efe33 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:21.188553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2ae09-a97a-41f1-a044-7de3189efe33 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:21.189905 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2ae09-a97a-41f1-a044-7de3189efe33 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-395897c1-6d23-4802-8604-4355e818076d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:21.195062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:21.196470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:21.197345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:21.197345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:21.197345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:21.197345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:21.197345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:21.197345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:21.197345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:21.197345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:21.201625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 422/846] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-09d2ae09-a97a-41f1-a044-7de3189efe33 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:21.202232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:21.203213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:20:21.209450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:21.210182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db058b-2f07-49d2-ab73-2c31353f945b None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:21.210182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db058b-2f07-49d2-ab73-2c31353f945b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:21.210182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db058b-2f07-49d2-ab73-2c31353f945b None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:21.210419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 425/847] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:20:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:21.210419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2ae09-a97a-41f1-a044-7de3189efe33 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:21.210545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 423/848] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:21.210545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db058b-2f07-49d2-ab73-2c31353f945b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:21.241964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:21.318092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db058b-2f07-49d2-ab73-2c31353f945b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:21.357464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b3e9b-a17d-4521-b0b0-32bae374f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:21.358373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b3e9b-a17d-4521-b0b0-32bae374f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:21.358818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b3e9b-a17d-4521-b0b0-32bae374f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:21.359093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b3e9b-a17d-4521-b0b0-32bae374f1a0 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:21.359789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b3e9b-a17d-4521-b0b0-32bae374f1a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:21.360097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b3e9b-a17d-4521-b0b0-32bae374f1a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:21.361450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b3e9b-a17d-4521-b0b0-32bae374f1a0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:21.370386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 424/849] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:20:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:21.370386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b1b59-e48c-4f2d-be1a-10f729e95722 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:21.370386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b1b59-e48c-4f2d-be1a-10f729e95722 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:21.370386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b1b59-e48c-4f2d-be1a-10f729e95722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:21.385784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c89b1b59-e48c-4f2d-be1a-10f729e95722 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:21.386995 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c89b1b59-e48c-4f2d-be1a-10f729e95722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:21.449219 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2ae09-a97a-41f1-a044-7de3189efe33 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:21.458454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 425/850] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:21.458454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b1b59-e48c-4f2d-be1a-10f729e95722 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:21.475395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:21.481984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:21.496972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13aba6-acfb-4754-8f80-aef3d3142e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:21.497638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13aba6-acfb-4754-8f80-aef3d3142e49 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:21.497927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13aba6-acfb-4754-8f80-aef3d3142e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:21.498209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13aba6-acfb-4754-8f80-aef3d3142e49 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:21.499044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13aba6-acfb-4754-8f80-aef3d3142e49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:21.499355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13aba6-acfb-4754-8f80-aef3d3142e49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:21.500792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13aba6-acfb-4754-8f80-aef3d3142e49 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:21.512929 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 426/851] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:21.513722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13aba6-acfb-4754-8f80-aef3d3142e49 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:21.573559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b1b59-e48c-4f2d-be1a-10f729e95722 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:21.612240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10140459-5a1f-492d-932b-b67456371e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:21.612825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10140459-5a1f-492d-932b-b67456371e4c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:21.613108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10140459-5a1f-492d-932b-b67456371e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:21.613382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10140459-5a1f-492d-932b-b67456371e4c None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:21.614072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10140459-5a1f-492d-932b-b67456371e4c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:21.614395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10140459-5a1f-492d-932b-b67456371e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:21.615748 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10140459-5a1f-492d-932b-b67456371e4c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:21.621131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 426/852] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:20:21 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:21.621562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13aba6-acfb-4754-8f80-aef3d3142e49 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:21.621927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10140459-5a1f-492d-932b-b67456371e4c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:21.662323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb78cf-d35a-4587-b8da-be5f97a4db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:21.663379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb78cf-d35a-4587-b8da-be5f97a4db91 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:21.663736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb78cf-d35a-4587-b8da-be5f97a4db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:21.664083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb78cf-d35a-4587-b8da-be5f97a4db91 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:21.664984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb78cf-d35a-4587-b8da-be5f97a4db91 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:21.666611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb78cf-d35a-4587-b8da-be5f97a4db91 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1fbb78cf-d35a-4587-b8da-be5f97a4db91 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:21.681286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:21.682603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:20:21.683666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:21.685311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 427/853] 10.222.0.44 () {56 vars in 1132 bytes} [Fri Jun 24 10:20:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:21.696098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb78cf-d35a-4587-b8da-be5f97a4db91 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:21.746426 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:21.752290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:21.767361 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10140459-5a1f-492d-932b-b67456371e4c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:21.808869 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbfc4c-e659-46d3-8ced-4a0f7e5e880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:21.809534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbfc4c-e659-46d3-8ced-4a0f7e5e880a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:21.809826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbfc4c-e659-46d3-8ced-4a0f7e5e880a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:21.810106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbfc4c-e659-46d3-8ced-4a0f7e5e880a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:21.811156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbfc4c-e659-46d3-8ced-4a0f7e5e880a None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=67ae1a0fbb4f44e6b60281ce63dc68fe) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:21.811273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbfc4c-e659-46d3-8ced-4a0f7e5e880a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:21.812694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbfc4c-e659-46d3-8ced-4a0f7e5e880a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:21.822403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 427/854] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:21 2022] GET /identity/v3/role_assignments?user.id=67ae1a0fbb4f44e6b60281ce63dc68fe&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:21.830513 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb78cf-d35a-4587-b8da-be5f97a4db91 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:21.873630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81bb1b-7d7c-471c-be06-ef56d7f2989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:21.874232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81bb1b-7d7c-471c-be06-ef56d7f2989d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:21.874550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81bb1b-7d7c-471c-be06-ef56d7f2989d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:21.874827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81bb1b-7d7c-471c-be06-ef56d7f2989d None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:21.875559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81bb1b-7d7c-471c-be06-ef56d7f2989d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:21.875870 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81bb1b-7d7c-471c-be06-ef56d7f2989d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:21.877303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81bb1b-7d7c-471c-be06-ef56d7f2989d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:21.883145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 428/855] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:21.888888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbfc4c-e659-46d3-8ced-4a0f7e5e880a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:22.014321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbfc4c-e659-46d3-8ced-4a0f7e5e880a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:22.054667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f2885-db36-4b55-a811-325a8b79b82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:22.056161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f2885-db36-4b55-a811-325a8b79b82c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:22.056611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f2885-db36-4b55-a811-325a8b79b82c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:22.057039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f2885-db36-4b55-a811-325a8b79b82c None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:22.057892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f2885-db36-4b55-a811-325a8b79b82c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:22.058375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f2885-db36-4b55-a811-325a8b79b82c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:22.059939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f2885-db36-4b55-a811-325a8b79b82c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:22.065415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 428/856] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:22.084304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb5e95-146b-4424-ac69-a2d76f8aa9ad None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:22.084591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb5e95-146b-4424-ac69-a2d76f8aa9ad None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:22.084872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb5e95-146b-4424-ac69-a2d76f8aa9ad None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:22.088266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 429/857] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:22.093021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87894f8-f675-4850-9a85-fc7db0138493 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:22.093311 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87894f8-f675-4850-9a85-fc7db0138493 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:22.093588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87894f8-f675-4850-9a85-fc7db0138493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:22.111742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d87894f8-f675-4850-9a85-fc7db0138493 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:22.112952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d87894f8-f675-4850-9a85-fc7db0138493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:22.128816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:22.197764 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 429/858] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:22.217668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb5e95-146b-4424-ac69-a2d76f8aa9ad None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:22.332774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb5e95-146b-4424-ac69-a2d76f8aa9ad None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:22.340787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:22.369930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f25470-8751-40da-b418-7d165932ac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:22.370284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f25470-8751-40da-b418-7d165932ac42 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:22.370479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f25470-8751-40da-b418-7d165932ac42 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:22.370637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f25470-8751-40da-b418-7d165932ac42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:22.381230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f25470-8751-40da-b418-7d165932ac42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-99f25470-8751-40da-b418-7d165932ac42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:22.388753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:22.390938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:20:22.392966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:22.394517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 430/859] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:20:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:22.400209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87894f8-f675-4850-9a85-fc7db0138493 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:22.504707 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87894f8-f675-4850-9a85-fc7db0138493 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:22.540464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799052c-6835-41df-8beb-96e57a7392ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:22.541125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799052c-6835-41df-8beb-96e57a7392ce None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:22.541403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799052c-6835-41df-8beb-96e57a7392ce None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:22.541675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799052c-6835-41df-8beb-96e57a7392ce None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:22.542493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799052c-6835-41df-8beb-96e57a7392ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:22.542797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799052c-6835-41df-8beb-96e57a7392ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:22.544142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799052c-6835-41df-8beb-96e57a7392ce None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:22.557312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 430/860] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:20:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:22.558676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f25470-8751-40da-b418-7d165932ac42 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:22.663999 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f25470-8751-40da-b418-7d165932ac42 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:22.698728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef599841-8923-4c57-8996-c546b951e440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:22.699510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599841-8923-4c57-8996-c546b951e440 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:22.699791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599841-8923-4c57-8996-c546b951e440 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:22.700061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599841-8923-4c57-8996-c546b951e440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:22.711761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef599841-8923-4c57-8996-c546b951e440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:22.713199 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef599841-8923-4c57-8996-c546b951e440 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ef599841-8923-4c57-8996-c546b951e440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:22.729947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:22.732039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:22.734118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:22.734118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:22.734118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:22.734118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:22.737518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 431/861] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:22.737707 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799052c-6835-41df-8beb-96e57a7392ce None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:22.750222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:22.840307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799052c-6835-41df-8beb-96e57a7392ce None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:22.874629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1378be-d813-4329-b232-812c6d00d611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:22.875306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1378be-d813-4329-b232-812c6d00d611 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:22.875588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1378be-d813-4329-b232-812c6d00d611 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:22.875866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1378be-d813-4329-b232-812c6d00d611 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:22.876594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1378be-d813-4329-b232-812c6d00d611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:22.876901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1378be-d813-4329-b232-812c6d00d611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:22.878291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1378be-d813-4329-b232-812c6d00d611 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:22.896612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 431/862] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:22.897975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef599841-8923-4c57-8996-c546b951e440 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:22.918110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:23.001761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef599841-8923-4c57-8996-c546b951e440 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:23.037704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c5e8-8675-493e-97aa-4ba28c264d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:23.038847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c5e8-8675-493e-97aa-4ba28c264d1c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:23.039160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c5e8-8675-493e-97aa-4ba28c264d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:23.039440 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c5e8-8675-493e-97aa-4ba28c264d1c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:23.047989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968c5e8-8675-493e-97aa-4ba28c264d1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:23.049426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968c5e8-8675-493e-97aa-4ba28c264d1c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e968c5e8-8675-493e-97aa-4ba28c264d1c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:23.064205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:23.066338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:23.068588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:23.068588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:23.068588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:23.068588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:23.068588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:23.068588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:23.068588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:23.068588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:23.068588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:23.068588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:23.070992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 432/863] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Jun 24 10:20:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:23.072387 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1378be-d813-4329-b232-812c6d00d611 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:23.148695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:23.180317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1378be-d813-4329-b232-812c6d00d611 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:23.215219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84afa5-7d92-4767-925a-e21b153a383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:23.215891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84afa5-7d92-4767-925a-e21b153a383a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:23.216184 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84afa5-7d92-4767-925a-e21b153a383a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:23.216467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84afa5-7d92-4767-925a-e21b153a383a None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:23.217300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84afa5-7d92-4767-925a-e21b153a383a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:23.217612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84afa5-7d92-4767-925a-e21b153a383a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:23.222541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84afa5-7d92-4767-925a-e21b153a383a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:23.241096 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 432/864] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Jun 24 10:20:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:23.250379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c5e8-8675-493e-97aa-4ba28c264d1c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:23.330445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:23.353708 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c5e8-8675-493e-97aa-4ba28c264d1c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:23.387792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b83927-b808-4e65-8849-8067dba22453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:23.388451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b83927-b808-4e65-8849-8067dba22453 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:23.388737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b83927-b808-4e65-8849-8067dba22453 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:23.389010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b83927-b808-4e65-8849-8067dba22453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:23.457692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b83927-b808-4e65-8849-8067dba22453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:23.459085 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b83927-b808-4e65-8849-8067dba22453 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:23.535828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:23.563852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 433/865] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:20:23.565272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84afa5-7d92-4767-925a-e21b153a383a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:23.673961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84afa5-7d92-4767-925a-e21b153a383a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:23.701427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:23.710156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3670a50-a705-410f-a3d2-39b0869447c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:23.710931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3670a50-a705-410f-a3d2-39b0869447c2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:23.711746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3670a50-a705-410f-a3d2-39b0869447c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:23.712022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3670a50-a705-410f-a3d2-39b0869447c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:23.722294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3670a50-a705-410f-a3d2-39b0869447c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:23.723759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3670a50-a705-410f-a3d2-39b0869447c2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-c3670a50-a705-410f-a3d2-39b0869447c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:23.741743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:23.742743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:23.743644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:23.743644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:23.743644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:23.743644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:23.747588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 433/866] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:23.748943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b83927-b808-4e65-8849-8067dba22453 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:23.828155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7cc8f-1330-4c96-9edb-43b560a00bf7 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:23.828833 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7cc8f-1330-4c96-9edb-43b560a00bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:23.829122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7cc8f-1330-4c96-9edb-43b560a00bf7 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:23.831417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 434/867] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:23.838226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1db77e-8d7b-4776-93ad-ac8040ae4a43 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:23.838917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1db77e-8d7b-4776-93ad-ac8040ae4a43 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:23.839300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1db77e-8d7b-4776-93ad-ac8040ae4a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:23.855608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b83927-b808-4e65-8849-8067dba22453 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:23.861703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ec1db77e-8d7b-4776-93ad-ac8040ae4a43 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:23.863050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ec1db77e-8d7b-4776-93ad-ac8040ae4a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:23.891599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf463ad-9b72-482e-b421-4589c5152a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:23.892426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf463ad-9b72-482e-b421-4589c5152a5b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:23.892810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf463ad-9b72-482e-b421-4589c5152a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:23.893186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf463ad-9b72-482e-b421-4589c5152a5b None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:23.894007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf463ad-9b72-482e-b421-4589c5152a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:23.894445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf463ad-9b72-482e-b421-4589c5152a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:23.895904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf463ad-9b72-482e-b421-4589c5152a5b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:23.912535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 434/868] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:23.915231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf463ad-9b72-482e-b421-4589c5152a5b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:23.942669 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 435/869] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:23.960775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:23.963979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1db77e-8d7b-4776-93ad-ac8040ae4a43 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:24.025770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf463ad-9b72-482e-b421-4589c5152a5b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:24.061173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cff64-85f4-4123-b31c-8217c65439c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:24.062241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cff64-85f4-4123-b31c-8217c65439c9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.062815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cff64-85f4-4123-b31c-8217c65439c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.063097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cff64-85f4-4123-b31c-8217c65439c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.072745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cff64-85f4-4123-b31c-8217c65439c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:24.072887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1db77e-8d7b-4776-93ad-ac8040ae4a43 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:24.074180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cff64-85f4-4123-b31c-8217c65439c9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:24.084333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-283cff64-85f4-4123-b31c-8217c65439c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:24.089450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:24.090379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:24.091295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:24.091295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:24.091295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:24.091295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:24.091295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:24.091295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:24.091295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:24.091295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:24.091295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 435/870] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:24.092399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa976878-6017-4381-9943-fc7e747e0495 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.092399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa976878-6017-4381-9943-fc7e747e0495 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.092399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa976878-6017-4381-9943-fc7e747e0495 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.093743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 436/871] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:24.096377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa976878-6017-4381-9943-fc7e747e0495 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:24.117465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94624aa-4f5c-475f-9f5b-abdab8679e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:24.118554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94624aa-4f5c-475f-9f5b-abdab8679e10 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.119073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94624aa-4f5c-475f-9f5b-abdab8679e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.119560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94624aa-4f5c-475f-9f5b-abdab8679e10 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.120470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94624aa-4f5c-475f-9f5b-abdab8679e10 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:24.122219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94624aa-4f5c-475f-9f5b-abdab8679e10 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:24.139229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 436/872] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:20:23 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:24.140895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdd544-2be7-4d2c-b09a-a472bbdf9ef8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.141477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdd544-2be7-4d2c-b09a-a472bbdf9ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.141786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdd544-2be7-4d2c-b09a-a472bbdf9ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.162982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d1fdd544-2be7-4d2c-b09a-a472bbdf9ef8 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:24.164284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d1fdd544-2be7-4d2c-b09a-a472bbdf9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:24.222917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:24.236818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa976878-6017-4381-9943-fc7e747e0495 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:24.269316 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 437/873] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:24.271096 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a14c9-41d5-43a3-b3bd-4f4a5dc16fb4 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.271661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a14c9-41d5-43a3-b3bd-4f4a5dc16fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.272116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a14c9-41d5-43a3-b3bd-4f4a5dc16fb4 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.274514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 438/874] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:24.276443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d28f1c-4f14-41b7-979b-5db00efe569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:24.277121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28f1c-4f14-41b7-979b-5db00efe569b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.277404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28f1c-4f14-41b7-979b-5db00efe569b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.277678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28f1c-4f14-41b7-979b-5db00efe569b None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.282602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d28f1c-4f14-41b7-979b-5db00efe569b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:24.282602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d28f1c-4f14-41b7-979b-5db00efe569b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:24.282602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d28f1c-4f14-41b7-979b-5db00efe569b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:24.284700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bdcef-3fc6-4d8e-a4fd-f503512580a2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.285205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bdcef-3fc6-4d8e-a4fd-f503512580a2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.285718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bdcef-3fc6-4d8e-a4fd-f503512580a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.301372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 437/875] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:24.301372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d28f1c-4f14-41b7-979b-5db00efe569b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:24.307127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7a9bdcef-3fc6-4d8e-a4fd-f503512580a2 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:24.308359 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7a9bdcef-3fc6-4d8e-a4fd-f503512580a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:24.388782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 439/876] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:24.389648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bdcef-3fc6-4d8e-a4fd-f503512580a2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:24.418269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d28f1c-4f14-41b7-979b-5db00efe569b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:24.429086 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:24.454533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bd425-4b5c-4841-9194-df1f6da700c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:24.455341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bd425-4b5c-4841-9194-df1f6da700c5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.455626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bd425-4b5c-4841-9194-df1f6da700c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.455904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bd425-4b5c-4841-9194-df1f6da700c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.456556 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bd425-4b5c-4841-9194-df1f6da700c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:24.457931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bd425-4b5c-4841-9194-df1f6da700c5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-b19bd425-4b5c-4841-9194-df1f6da700c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:24.469933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:24.471192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:24.472140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 438/877] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:24.473053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bd425-4b5c-4841-9194-df1f6da700c5 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:24.492822 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:24.515126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bdcef-3fc6-4d8e-a4fd-f503512580a2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:24.551314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce13401-7908-4491-91ca-8f0b88560db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:24.552031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce13401-7908-4491-91ca-8f0b88560db9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.552511 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce13401-7908-4491-91ca-8f0b88560db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.552628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce13401-7908-4491-91ca-8f0b88560db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.553447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce13401-7908-4491-91ca-8f0b88560db9 None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=f75e1cb00d8b44988b660c753d498f77) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:24.553862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce13401-7908-4491-91ca-8f0b88560db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:24.555751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce13401-7908-4491-91ca-8f0b88560db9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:24.563635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 440/878] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:24 2022] GET /identity/v3/role_assignments?user.id=f75e1cb00d8b44988b660c753d498f77&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:24.564464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce13401-7908-4491-91ca-8f0b88560db9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:24.596149 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bd425-4b5c-4841-9194-df1f6da700c5 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:24.642712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899cdd-065a-4f2c-9223-f78149987f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:24.643555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899cdd-065a-4f2c-9223-f78149987f62 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.643839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899cdd-065a-4f2c-9223-f78149987f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.644112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899cdd-065a-4f2c-9223-f78149987f62 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.644852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899cdd-065a-4f2c-9223-f78149987f62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:24.647188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899cdd-065a-4f2c-9223-f78149987f62 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:24.668789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 439/879] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:20:24 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:24.701856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:24.710291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce13401-7908-4491-91ca-8f0b88560db9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:24.765696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0f2d4-64e0-4013-aa0c-66953730c3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:24.766370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f2d4-64e0-4013-aa0c-66953730c3db None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.766675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f2d4-64e0-4013-aa0c-66953730c3db None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.766940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f2d4-64e0-4013-aa0c-66953730c3db None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.767651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0f2d4-64e0-4013-aa0c-66953730c3db None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:24.767957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0f2d4-64e0-4013-aa0c-66953730c3db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:24.769401 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0f2d4-64e0-4013-aa0c-66953730c3db None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:24.775263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 441/880] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Jun 24 10:20:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:24.781228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899cdd-065a-4f2c-9223-f78149987f62 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:24.873187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:24.901714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899cdd-065a-4f2c-9223-f78149987f62 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:24.938388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630958ee-6c62-4eab-a0ea-eb6244c55030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:24.939073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630958ee-6c62-4eab-a0ea-eb6244c55030 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:24.939358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630958ee-6c62-4eab-a0ea-eb6244c55030 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:24.939631 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630958ee-6c62-4eab-a0ea-eb6244c55030 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:24.940344 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630958ee-6c62-4eab-a0ea-eb6244c55030 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:24.940648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630958ee-6c62-4eab-a0ea-eb6244c55030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:24.942011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630958ee-6c62-4eab-a0ea-eb6244c55030 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:24.947325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 440/881] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Jun 24 10:20:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:26.249423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052dc06-2278-47f5-a284-018f1ee97589 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:26.249943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052dc06-2278-47f5-a284-018f1ee97589 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:26.250020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052dc06-2278-47f5-a284-018f1ee97589 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:26.251541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 442/882] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:26.256848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd510c5-5685-4deb-81ce-db71ae6e3bb9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:26.258230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd510c5-5685-4deb-81ce-db71ae6e3bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:26.258734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd510c5-5685-4deb-81ce-db71ae6e3bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:26.276360 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-bfd510c5-5685-4deb-81ce-db71ae6e3bb9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:26.277806 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bfd510c5-5685-4deb-81ce-db71ae6e3bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:26.349861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 441/883] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:26.372491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052dc06-2278-47f5-a284-018f1ee97589 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:26.485848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052dc06-2278-47f5-a284-018f1ee97589 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:26.522558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173118a-60a8-4c46-affa-c9f28cf07c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:26.523320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173118a-60a8-4c46-affa-c9f28cf07c2e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:26.524124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173118a-60a8-4c46-affa-c9f28cf07c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:26.524396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173118a-60a8-4c46-affa-c9f28cf07c2e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:26.525036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173118a-60a8-4c46-affa-c9f28cf07c2e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:26.526409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173118a-60a8-4c46-affa-c9f28cf07c2e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4173118a-60a8-4c46-affa-c9f28cf07c2e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:26.538196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:26.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:26.540238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 443/884] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:20:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:26.547816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd510c5-5685-4deb-81ce-db71ae6e3bb9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:26.633545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:26.664905 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd510c5-5685-4deb-81ce-db71ae6e3bb9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:26.701205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5abd3-e3de-49d7-b24a-1f0dc637ec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:26.702232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5abd3-e3de-49d7-b24a-1f0dc637ec4c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:26.702744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5abd3-e3de-49d7-b24a-1f0dc637ec4c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:26.703240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5abd3-e3de-49d7-b24a-1f0dc637ec4c None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:26.704183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5abd3-e3de-49d7-b24a-1f0dc637ec4c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:26.704689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5abd3-e3de-49d7-b24a-1f0dc637ec4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:26.706257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5abd3-e3de-49d7-b24a-1f0dc637ec4c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:26.716200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 442/885] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:20:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:26.719426 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173118a-60a8-4c46-affa-c9f28cf07c2e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:26.739055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b87a3-efed-4548-807e-8394b9f85397 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:26.739652 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b87a3-efed-4548-807e-8394b9f85397 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:26.740140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b87a3-efed-4548-807e-8394b9f85397 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:26.740634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:26.743059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 443/886] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:26.748691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb124069-614a-4220-b1ac-9d6e8cbb0aa0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:26.749007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb124069-614a-4220-b1ac-9d6e8cbb0aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:26.749932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb124069-614a-4220-b1ac-9d6e8cbb0aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:26.768124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fb124069-614a-4220-b1ac-9d6e8cbb0aa0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:26.769401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fb124069-614a-4220-b1ac-9d6e8cbb0aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:26.840999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173118a-60a8-4c46-affa-c9f28cf07c2e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:26.842644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 444/887] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:26.844162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b2e6-888b-4d40-a6b8-a3de1bbf6806 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:26.844610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b2e6-888b-4d40-a6b8-a3de1bbf6806 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:26.845031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b2e6-888b-4d40-a6b8-a3de1bbf6806 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:26.846503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 445/888] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:26.851978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c5cd-d473-4962-ba1d-6215985ff96a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:26.852273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c5cd-d473-4962-ba1d-6215985ff96a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:26.852555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c5cd-d473-4962-ba1d-6215985ff96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:26.870771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e229c5cd-d473-4962-ba1d-6215985ff96a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:26.872163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e229c5cd-d473-4962-ba1d-6215985ff96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:26.879982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264eddbd-9e69-41d5-92bc-96ee2d451931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:26.880656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eddbd-9e69-41d5-92bc-96ee2d451931 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:26.880948 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eddbd-9e69-41d5-92bc-96ee2d451931 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:26.881225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eddbd-9e69-41d5-92bc-96ee2d451931 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:26.881936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264eddbd-9e69-41d5-92bc-96ee2d451931 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:26.882241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264eddbd-9e69-41d5-92bc-96ee2d451931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:26.883691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264eddbd-9e69-41d5-92bc-96ee2d451931 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:26.888694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 444/889] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:20:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:26.889476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264eddbd-9e69-41d5-92bc-96ee2d451931 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:26.941188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:26.950334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 446/890] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:26.951660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229c5cd-d473-4962-ba1d-6215985ff96a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:26.981725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:27.001552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264eddbd-9e69-41d5-92bc-96ee2d451931 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.039254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fdb7c-6d0e-448b-b44c-afee97f1ad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.040066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fdb7c-6d0e-448b-b44c-afee97f1ad20 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.040352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fdb7c-6d0e-448b-b44c-afee97f1ad20 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.040634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fdb7c-6d0e-448b-b44c-afee97f1ad20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.050978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fdb7c-6d0e-448b-b44c-afee97f1ad20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-d90fdb7c-6d0e-448b-b44c-afee97f1ad20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:27.059110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:27.060244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:27.061280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 445/891] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Jun 24 10:20:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:27.062058 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fdb7c-6d0e-448b-b44c-afee97f1ad20 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:27.066122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229c5cd-d473-4962-ba1d-6215985ff96a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.100570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad85bd-4261-49b5-8db6-d0c485428c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.101159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad85bd-4261-49b5-8db6-d0c485428c84 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.101466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad85bd-4261-49b5-8db6-d0c485428c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.101738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad85bd-4261-49b5-8db6-d0c485428c84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.102545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad85bd-4261-49b5-8db6-d0c485428c84 None admin] RBAC: Adding query filter params (interface=public, service_id=253a83a2a8654c7eaa31999aa8174c79, region_id=RegionOne) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:27.102853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad85bd-4261-49b5-8db6-d0c485428c84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:27.104203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad85bd-4261-49b5-8db6-d0c485428c84 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:27.109103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 447/892] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Jun 24 10:20:26 2022] GET /identity/v3/endpoints?service_id=253a83a2a8654c7eaa31999aa8174c79&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:27.110272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c893503-332b-4caa-b77e-bb38c6e42c31 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.110581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c893503-332b-4caa-b77e-bb38c6e42c31 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.110854 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c893503-332b-4caa-b77e-bb38c6e42c31 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.112057 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 448/893] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:27.112737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c893503-332b-4caa-b77e-bb38c6e42c31 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:27.170649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fdb7c-6d0e-448b-b44c-afee97f1ad20 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.174944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:27.203988 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894363e-cd66-4966-9544-a4319209a2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.204792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894363e-cd66-4966-9544-a4319209a2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.205078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894363e-cd66-4966-9544-a4319209a2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.205354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894363e-cd66-4966-9544-a4319209a2c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.205998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894363e-cd66-4966-9544-a4319209a2c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:27.207392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894363e-cd66-4966-9544-a4319209a2c1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:27.217660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c893503-332b-4caa-b77e-bb38c6e42c31 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4894363e-cd66-4966-9544-a4319209a2c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:27.219907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:27.221004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:27.221866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 446/894] 10.222.0.44 () {56 vars in 1132 bytes} [Fri Jun 24 10:20:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:27.222921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894363e-cd66-4966-9544-a4319209a2c1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:27.234210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:27.252728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4241-9100-40c1-baf6-b7499828a40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.253397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4241-9100-40c1-baf6-b7499828a40e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.253675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4241-9100-40c1-baf6-b7499828a40e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.253959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4241-9100-40c1-baf6-b7499828a40e None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.254740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4241-9100-40c1-baf6-b7499828a40e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:27.255050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4241-9100-40c1-baf6-b7499828a40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:27.256403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4241-9100-40c1-baf6-b7499828a40e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:27.264847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 449/895] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Jun 24 10:20:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:27.265997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2caf-e4a3-4d99-8de3-68626aaa5bc2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.266292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2caf-e4a3-4d99-8de3-68626aaa5bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.266603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b2caf-e4a3-4d99-8de3-68626aaa5bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.282679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-de8b2caf-e4a3-4d99-8de3-68626aaa5bc2 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:27.283874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-de8b2caf-e4a3-4d99-8de3-68626aaa5bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:27.329237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894363e-cd66-4966-9544-a4319209a2c1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.349118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 450/896] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:27.349934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b2caf-e4a3-4d99-8de3-68626aaa5bc2 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:27.371375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65522b51-c7d4-41f9-b85e-c5a50dc655df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.371968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65522b51-c7d4-41f9-b85e-c5a50dc655df None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.372252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65522b51-c7d4-41f9-b85e-c5a50dc655df None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.372534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65522b51-c7d4-41f9-b85e-c5a50dc655df None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.373214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65522b51-c7d4-41f9-b85e-c5a50dc655df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:27.374837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65522b51-c7d4-41f9-b85e-c5a50dc655df None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:27.380321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 447/897] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Jun 24 10:20:27 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:20:27.381102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65522b51-c7d4-41f9-b85e-c5a50dc655df None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:27.405118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:27.464118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b2caf-e4a3-4d99-8de3-68626aaa5bc2 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.484235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:27.503538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2358583-a316-44ac-84f3-abbb79d1677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.504230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2358583-a316-44ac-84f3-abbb79d1677c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.504520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2358583-a316-44ac-84f3-abbb79d1677c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.504797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2358583-a316-44ac-84f3-abbb79d1677c None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.505516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2358583-a316-44ac-84f3-abbb79d1677c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:27.506341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2358583-a316-44ac-84f3-abbb79d1677c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:27.508420 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2358583-a316-44ac-84f3-abbb79d1677c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:27.513888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 451/898] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:27.514608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2358583-a316-44ac-84f3-abbb79d1677c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:27.525170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65522b51-c7d4-41f9-b85e-c5a50dc655df None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.573116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5eabd-5f22-4c2f-990c-2b59ea63cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.573923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5eabd-5f22-4c2f-990c-2b59ea63cfbd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.574919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5eabd-5f22-4c2f-990c-2b59ea63cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.574919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5eabd-5f22-4c2f-990c-2b59ea63cfbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.592405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5eabd-5f22-4c2f-990c-2b59ea63cfbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:27.594472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5eabd-5f22-4c2f-990c-2b59ea63cfbd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-22f5eabd-5f22-4c2f-990c-2b59ea63cfbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:27.612209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:27.613133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:27.614889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:27.614889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:27.614889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:27.614889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:27.614889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 448/899] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:27.614889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5eabd-5f22-4c2f-990c-2b59ea63cfbd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:27.627697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2358583-a316-44ac-84f3-abbb79d1677c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.645069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:27.665251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f04010-383d-4695-a142-4e585ebc8667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.665915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04010-383d-4695-a142-4e585ebc8667 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.666201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04010-383d-4695-a142-4e585ebc8667 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.666510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04010-383d-4695-a142-4e585ebc8667 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.667235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f04010-383d-4695-a142-4e585ebc8667 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:27.668657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f04010-383d-4695-a142-4e585ebc8667 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:27.682294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 452/900] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:20:27 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:27.683212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f04010-383d-4695-a142-4e585ebc8667 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:27.754682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5eabd-5f22-4c2f-990c-2b59ea63cfbd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.789347 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:27.810216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b3cb1-9180-4cd0-8de6-47ed90419b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.810957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b3cb1-9180-4cd0-8de6-47ed90419b25 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.811247 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b3cb1-9180-4cd0-8de6-47ed90419b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.811524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b3cb1-9180-4cd0-8de6-47ed90419b25 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.812308 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b3cb1-9180-4cd0-8de6-47ed90419b25 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:27.812622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b3cb1-9180-4cd0-8de6-47ed90419b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:27.814090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b3cb1-9180-4cd0-8de6-47ed90419b25 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:27.814315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f04010-383d-4695-a142-4e585ebc8667 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.825557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 449/901] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:27.826604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b3cb1-9180-4cd0-8de6-47ed90419b25 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:27.860168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3e6d6-1e74-4b81-9d07-a496f67b691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.860833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e6d6-1e74-4b81-9d07-a496f67b691c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.861131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e6d6-1e74-4b81-9d07-a496f67b691c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.862624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e6d6-1e74-4b81-9d07-a496f67b691c None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.863061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3e6d6-1e74-4b81-9d07-a496f67b691c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:27.863251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3e6d6-1e74-4b81-9d07-a496f67b691c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:27.864612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3e6d6-1e74-4b81-9d07-a496f67b691c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:27.880631 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 453/902] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:27.886498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3e6d6-1e74-4b81-9d07-a496f67b691c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:27.940365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:27.941979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b3cb1-9180-4cd0-8de6-47ed90419b25 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:27.987881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cce01-74d6-4cec-9b38-610afac18e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:27.988573 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cce01-74d6-4cec-9b38-610afac18e9c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:27.988866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cce01-74d6-4cec-9b38-610afac18e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:27.989141 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cce01-74d6-4cec-9b38-610afac18e9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:27.989932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cce01-74d6-4cec-9b38-610afac18e9c None admin] RBAC: Adding query filter params (interface=public, service_id=f23eaf57c10441b5b7081e8ca475d652, region_id=RegionOne) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:27.990244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cce01-74d6-4cec-9b38-610afac18e9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:27.991766 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cce01-74d6-4cec-9b38-610afac18e9c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:27.997484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 450/903] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Jun 24 10:20:27 2022] GET /identity/v3/endpoints?service_id=f23eaf57c10441b5b7081e8ca475d652&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:28.002683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cce01-74d6-4cec-9b38-610afac18e9c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:28.031294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3e6d6-1e74-4b81-9d07-a496f67b691c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:28.054644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:28.083105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a18d3-5fcb-4ac5-b52d-d70fc55c2f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:28.084223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a18d3-5fcb-4ac5-b52d-d70fc55c2f92 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:28.084657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a18d3-5fcb-4ac5-b52d-d70fc55c2f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:28.085118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a18d3-5fcb-4ac5-b52d-d70fc55c2f92 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:28.096591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a18d3-5fcb-4ac5-b52d-d70fc55c2f92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:28.098048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a18d3-5fcb-4ac5-b52d-d70fc55c2f92 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c91a18d3-5fcb-4ac5-b52d-d70fc55c2f92 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:28.113633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:28.114857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:28.116184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 454/904] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Jun 24 10:20:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:28.121032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a18d3-5fcb-4ac5-b52d-d70fc55c2f92 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:28.123411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cce01-74d6-4cec-9b38-610afac18e9c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:28.168083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c6a88-86cd-4a55-8839-0c009d6dc7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:28.168792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c6a88-86cd-4a55-8839-0c009d6dc7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:28.169216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c6a88-86cd-4a55-8839-0c009d6dc7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:28.169567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c6a88-86cd-4a55-8839-0c009d6dc7b8 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:28.170396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c6a88-86cd-4a55-8839-0c009d6dc7b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:28.172680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c6a88-86cd-4a55-8839-0c009d6dc7b8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:28.186514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 451/905] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Jun 24 10:20:28 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:20:28.241781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:28.248586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a18d3-5fcb-4ac5-b52d-d70fc55c2f92 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:28.293828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80146b-69a9-42a7-a4d8-fe805ef70ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:28.295385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80146b-69a9-42a7-a4d8-fe805ef70ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:28.295877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80146b-69a9-42a7-a4d8-fe805ef70ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:28.296355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80146b-69a9-42a7-a4d8-fe805ef70ce0 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:28.297752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80146b-69a9-42a7-a4d8-fe805ef70ce0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:28.298273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80146b-69a9-42a7-a4d8-fe805ef70ce0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:28.300093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80146b-69a9-42a7-a4d8-fe805ef70ce0 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:28.323013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 455/906] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Jun 24 10:20:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:28.331129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c6a88-86cd-4a55-8839-0c009d6dc7b8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:28.439841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c6a88-86cd-4a55-8839-0c009d6dc7b8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:28.453990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:28.479361 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801f7ba-cd8e-436d-b62b-4c6c893a7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:28.480016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801f7ba-cd8e-436d-b62b-4c6c893a7baf None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:28.480306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801f7ba-cd8e-436d-b62b-4c6c893a7baf None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:28.480586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801f7ba-cd8e-436d-b62b-4c6c893a7baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:28.551999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801f7ba-cd8e-436d-b62b-4c6c893a7baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:28.553450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801f7ba-cd8e-436d-b62b-4c6c893a7baf None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:28.659426 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 452/907] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:28 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:20:28.665643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80146b-69a9-42a7-a4d8-fe805ef70ce0 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:28.779951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80146b-69a9-42a7-a4d8-fe805ef70ce0 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:28.815242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a476338-ba60-4376-a34f-5536ad146037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:28.816037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a476338-ba60-4376-a34f-5536ad146037 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:28.816325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a476338-ba60-4376-a34f-5536ad146037 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:28.816605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a476338-ba60-4376-a34f-5536ad146037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:28.827593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a476338-ba60-4376-a34f-5536ad146037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:28.829046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a476338-ba60-4376-a34f-5536ad146037 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-8a476338-ba60-4376-a34f-5536ad146037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:28.847819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:28.848809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:28.849712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:28.849712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:28.849712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:28.849712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:28.849712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 456/908] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:28.856236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801f7ba-cd8e-436d-b62b-4c6c893a7baf None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:28.871235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:28.965618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801f7ba-cd8e-436d-b62b-4c6c893a7baf None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:29.002543 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa6b14-af7c-40df-a78f-042f36033537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:29.003587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa6b14-af7c-40df-a78f-042f36033537 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:29.004081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa6b14-af7c-40df-a78f-042f36033537 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:29.004582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa6b14-af7c-40df-a78f-042f36033537 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:29.005529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa6b14-af7c-40df-a78f-042f36033537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:29.006034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa6b14-af7c-40df-a78f-042f36033537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:29.007662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa6b14-af7c-40df-a78f-042f36033537 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:29.020465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 453/909] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:29.026776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a476338-ba60-4376-a34f-5536ad146037 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:29.036103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:29.128896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a476338-ba60-4376-a34f-5536ad146037 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:29.167967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1005b-6de2-47de-a756-175575d793bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:29.170636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1005b-6de2-47de-a756-175575d793bc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:29.171157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1005b-6de2-47de-a756-175575d793bc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:29.172742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1005b-6de2-47de-a756-175575d793bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:29.180325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1005b-6de2-47de-a756-175575d793bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:29.182047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1005b-6de2-47de-a756-175575d793bc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d1d1005b-6de2-47de-a756-175575d793bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:29.196193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:29.197060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:29.198037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:29.198037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:29.198037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:29.198037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:29.198037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:29.198037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:29.198037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:29.198037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:29.200497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 457/910] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:29.206399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa6b14-af7c-40df-a78f-042f36033537 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:29.281044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:29.315449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa6b14-af7c-40df-a78f-042f36033537 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:29.351658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebff273-3fe7-49b7-9d8d-587f3876c329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:29.353147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebff273-3fe7-49b7-9d8d-587f3876c329 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:29.353632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebff273-3fe7-49b7-9d8d-587f3876c329 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:29.354106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebff273-3fe7-49b7-9d8d-587f3876c329 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:29.355113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebff273-3fe7-49b7-9d8d-587f3876c329 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:29.355624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebff273-3fe7-49b7-9d8d-587f3876c329 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:29.357262 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebff273-3fe7-49b7-9d8d-587f3876c329 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:29.371365 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 454/911] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:29.377515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1005b-6de2-47de-a756-175575d793bc None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:29.447123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:29.466470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a480543-0eb0-42b4-9fcf-def5eb945163 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:29.467098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a480543-0eb0-42b4-9fcf-def5eb945163 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:29.467620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a480543-0eb0-42b4-9fcf-def5eb945163 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:29.469455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 455/912] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:29.475297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63bf97-8c7c-4190-9631-033ad3e3a2a9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:29.475614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63bf97-8c7c-4190-9631-033ad3e3a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:29.475874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63bf97-8c7c-4190-9631-033ad3e3a2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:29.490608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1005b-6de2-47de-a756-175575d793bc None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:29.501682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7c63bf97-8c7c-4190-9631-033ad3e3a2a9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:29.503395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7c63bf97-8c7c-4190-9631-033ad3e3a2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:29.533742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8a7f4-83f6-4681-ab18-1bc43d1ea50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:29.534762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8a7f4-83f6-4681-ab18-1bc43d1ea50a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:29.535467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8a7f4-83f6-4681-ab18-1bc43d1ea50a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:29.535754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8a7f4-83f6-4681-ab18-1bc43d1ea50a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:29.536869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8a7f4-83f6-4681-ab18-1bc43d1ea50a None admin] RBAC: Adding query filter params (role.id=a36632e7ea7d4cbc904c35edc9e13bec, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=f75e1cb00d8b44988b660c753d498f77) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:29.537446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8a7f4-83f6-4681-ab18-1bc43d1ea50a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:29.540166 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8a7f4-83f6-4681-ab18-1bc43d1ea50a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:29.547208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 458/913] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:29 2022] GET /identity/v3/role_assignments?user.id=f75e1cb00d8b44988b660c753d498f77&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=a36632e7ea7d4cbc904c35edc9e13bec => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:29.594536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 456/914] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:29.615581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8a7f4-83f6-4681-ab18-1bc43d1ea50a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:29.729084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8a7f4-83f6-4681-ab18-1bc43d1ea50a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:29.760056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:29.766707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dc2b0-aca2-4e0d-92ed-066341251e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:29.767794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dc2b0-aca2-4e0d-92ed-066341251e34 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:29.768289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dc2b0-aca2-4e0d-92ed-066341251e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:29.768770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dc2b0-aca2-4e0d-92ed-066341251e34 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:29.769657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dc2b0-aca2-4e0d-92ed-066341251e34 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:29.771285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dc2b0-aca2-4e0d-92ed-066341251e34 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-f21dc2b0-aca2-4e0d-92ed-066341251e34 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:29.784271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:29.785317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 10:20:29.786146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:29.793677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 459/915] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:20:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:29.795342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63bf97-8c7c-4190-9631-033ad3e3a2a9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:29.822213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251025ee-c429-4d49-83ba-5548a853a0e8 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:29.822542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251025ee-c429-4d49-83ba-5548a853a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:29.822821 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251025ee-c429-4d49-83ba-5548a853a0e8 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:29.824204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 460/916] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:29.830374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445af89-2bcd-4f11-bcb1-a82328a8f495 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:29.830680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445af89-2bcd-4f11-bcb1-a82328a8f495 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:29.830967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445af89-2bcd-4f11-bcb1-a82328a8f495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:29.857574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7445af89-2bcd-4f11-bcb1-a82328a8f495 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:29.861350 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7445af89-2bcd-4f11-bcb1-a82328a8f495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:29.862477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:29.916118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63bf97-8c7c-4190-9631-033ad3e3a2a9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:29.955153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 461/917] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:29.964204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cba18-3199-44c0-b777-2beb3668e5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:29.964873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cba18-3199-44c0-b777-2beb3668e5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:29.965161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cba18-3199-44c0-b777-2beb3668e5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:29.965440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cba18-3199-44c0-b777-2beb3668e5a3 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:29.966154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cba18-3199-44c0-b777-2beb3668e5a3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:29.966611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cba18-3199-44c0-b777-2beb3668e5a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:29.967986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cba18-3199-44c0-b777-2beb3668e5a3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:29.978060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 457/918] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:20:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:29.979100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445af89-2bcd-4f11-bcb1-a82328a8f495 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:29.988266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cba18-3199-44c0-b777-2beb3668e5a3 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:30.115226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cba18-3199-44c0-b777-2beb3668e5a3 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:30.115680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445af89-2bcd-4f11-bcb1-a82328a8f495 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:30.146953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:30.147824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:30.162956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b2d5-2c46-433b-b911-2eee1861d837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:30.164345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b2d5-2c46-433b-b911-2eee1861d837 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.164473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b10c2f-57f1-45de-9bb1-b9149d3461f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:30.164643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b2d5-2c46-433b-b911-2eee1861d837 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.164919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b2d5-2c46-433b-b911-2eee1861d837 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.165301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b10c2f-57f1-45de-9bb1-b9149d3461f1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.165606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4b2d5-2c46-433b-b911-2eee1861d837 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:30.165704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b10c2f-57f1-45de-9bb1-b9149d3461f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.166016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b10c2f-57f1-45de-9bb1-b9149d3461f1 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.166834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b10c2f-57f1-45de-9bb1-b9149d3461f1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:30.167004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4b2d5-2c46-433b-b911-2eee1861d837 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:30.167455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b10c2f-57f1-45de-9bb1-b9149d3461f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:30.169083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b10c2f-57f1-45de-9bb1-b9149d3461f1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:30.175193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 458/919] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Jun 24 10:20:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a4d4b2d5-2c46-433b-b911-2eee1861d837 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:30.180075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:30.181074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:30.181927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 462/920] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:30.186375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b10c2f-57f1-45de-9bb1-b9149d3461f1 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:30.189352 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b2d5-2c46-433b-b911-2eee1861d837 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:30.292388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b2d5-2c46-433b-b911-2eee1861d837 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:30.294037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b10c2f-57f1-45de-9bb1-b9149d3461f1 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:30.329336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8098-5efe-4c93-9800-f0532264c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:30.330186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8098-5efe-4c93-9800-f0532264c57e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.330662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8098-5efe-4c93-9800-f0532264c57e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.331105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8098-5efe-4c93-9800-f0532264c57e None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.332000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422e82c-f468-43cb-ad53-407bb6f8b253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:30.332159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8098-5efe-4c93-9800-f0532264c57e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:30.332358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8098-5efe-4c93-9800-f0532264c57e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:30.333087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422e82c-f468-43cb-ad53-407bb6f8b253 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.333522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422e82c-f468-43cb-ad53-407bb6f8b253 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.333726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8098-5efe-4c93-9800-f0532264c57e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:30.334123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422e82c-f468-43cb-ad53-407bb6f8b253 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.335204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422e82c-f468-43cb-ad53-407bb6f8b253 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:30.337327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422e82c-f468-43cb-ad53-407bb6f8b253 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:30.339884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 463/921] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Jun 24 10:20:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:30.344898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8098-5efe-4c93-9800-f0532264c57e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:30.366466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 459/922] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Jun 24 10:20:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:30.418376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:30.460281 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22066ef5-546f-4ac3-af9c-c63d1efc5274 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.461166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22066ef5-546f-4ac3-af9c-c63d1efc5274 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.461395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22066ef5-546f-4ac3-af9c-c63d1efc5274 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.466799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 460/923] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:30.471369 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632eb1a-9195-4f57-ae82-e80901efd65e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.471897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632eb1a-9195-4f57-ae82-e80901efd65e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.472389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632eb1a-9195-4f57-ae82-e80901efd65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.478026 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8098-5efe-4c93-9800-f0532264c57e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:30.497853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0632eb1a-9195-4f57-ae82-e80901efd65e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:30.499131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0632eb1a-9195-4f57-ae82-e80901efd65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:30.531774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ac691-bbe1-41b6-9815-45bf38bbb631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:30.532881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac691-bbe1-41b6-9815-45bf38bbb631 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.533371 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac691-bbe1-41b6-9815-45bf38bbb631 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.533912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac691-bbe1-41b6-9815-45bf38bbb631 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.535048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ac691-bbe1-41b6-9815-45bf38bbb631 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:30.535568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ac691-bbe1-41b6-9815-45bf38bbb631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:30.537055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ac691-bbe1-41b6-9815-45bf38bbb631 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:30.543839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 464/924] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Jun 24 10:20:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:30.549377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:30.550747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ac691-bbe1-41b6-9815-45bf38bbb631 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:30.578142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 461/925] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:30.601965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632eb1a-9195-4f57-ae82-e80901efd65e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:30.675660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ac691-bbe1-41b6-9815-45bf38bbb631 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:30.694788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:30.714031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04728cf2-8de7-495e-95be-8b172bcd440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:30.714726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04728cf2-8de7-495e-95be-8b172bcd440c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.715013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04728cf2-8de7-495e-95be-8b172bcd440c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.715291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04728cf2-8de7-495e-95be-8b172bcd440c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.716194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04728cf2-8de7-495e-95be-8b172bcd440c None admin] RBAC: Adding query filter params (interface=public, service_id=d947160acfb94554b31a053afc042555, region_id=RegionOne) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:30.716511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04728cf2-8de7-495e-95be-8b172bcd440c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:30.717982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04728cf2-8de7-495e-95be-8b172bcd440c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:30.723396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632eb1a-9195-4f57-ae82-e80901efd65e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:30.723800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 465/926] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Jun 24 10:20:30 2022] GET /identity/v3/endpoints?service_id=d947160acfb94554b31a053afc042555&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:30.731356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04728cf2-8de7-495e-95be-8b172bcd440c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:30.774338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570623d-25fa-49eb-8a43-7f74b82a0712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:30.775723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570623d-25fa-49eb-8a43-7f74b82a0712 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.776220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570623d-25fa-49eb-8a43-7f74b82a0712 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.777530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570623d-25fa-49eb-8a43-7f74b82a0712 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.778475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570623d-25fa-49eb-8a43-7f74b82a0712 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:30.780062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570623d-25fa-49eb-8a43-7f74b82a0712 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3570623d-25fa-49eb-8a43-7f74b82a0712 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:30.796557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:30.797792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 10:20:30.798650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:30.800123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 462/927] 10.222.0.44 () {56 vars in 1132 bytes} [Fri Jun 24 10:20:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:30.809541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570623d-25fa-49eb-8a43-7f74b82a0712 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:30.859214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:30.862034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04728cf2-8de7-495e-95be-8b172bcd440c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:30.910005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230ac21-1683-4f8f-86b2-d8b778730566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:30.910878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230ac21-1683-4f8f-86b2-d8b778730566 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.911496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230ac21-1683-4f8f-86b2-d8b778730566 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.911876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230ac21-1683-4f8f-86b2-d8b778730566 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.913151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230ac21-1683-4f8f-86b2-d8b778730566 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:30.915021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230ac21-1683-4f8f-86b2-d8b778730566 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:30.924311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 466/928] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Jun 24 10:20:30 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:20:30.937044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570623d-25fa-49eb-8a43-7f74b82a0712 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:30.977221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce019381-151c-43ed-b51c-2bac2aa7e9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:30.977919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce019381-151c-43ed-b51c-2bac2aa7e9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:30.978267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce019381-151c-43ed-b51c-2bac2aa7e9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:30.978635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce019381-151c-43ed-b51c-2bac2aa7e9a5 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:30.979657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce019381-151c-43ed-b51c-2bac2aa7e9a5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:30.979979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce019381-151c-43ed-b51c-2bac2aa7e9a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:30.981648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce019381-151c-43ed-b51c-2bac2aa7e9a5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:30.989481 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 463/929] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:30.997095 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230ac21-1683-4f8f-86b2-d8b778730566 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:31.044996 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:31.111582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230ac21-1683-4f8f-86b2-d8b778730566 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:31.153701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7e770-3ef4-4a1a-92f8-fbc8aefbb688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:31.154385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7e770-3ef4-4a1a-92f8-fbc8aefbb688 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:31.154677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7e770-3ef4-4a1a-92f8-fbc8aefbb688 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:31.154948 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7e770-3ef4-4a1a-92f8-fbc8aefbb688 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:31.155709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7e770-3ef4-4a1a-92f8-fbc8aefbb688 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:31.156023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7e770-3ef4-4a1a-92f8-fbc8aefbb688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:31.157473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7e770-3ef4-4a1a-92f8-fbc8aefbb688 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:31.162766 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 467/930] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:31.168676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce019381-151c-43ed-b51c-2bac2aa7e9a5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:31.278917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce019381-151c-43ed-b51c-2bac2aa7e9a5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:31.280528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:31.315202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f5ecd-0d16-4546-9a76-044a8aaffcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:31.315867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f5ecd-0d16-4546-9a76-044a8aaffcc0 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:31.316156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f5ecd-0d16-4546-9a76-044a8aaffcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:31.316479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f5ecd-0d16-4546-9a76-044a8aaffcc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:31.317236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f5ecd-0d16-4546-9a76-044a8aaffcc0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:31.318663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f5ecd-0d16-4546-9a76-044a8aaffcc0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:31.340107 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 464/931] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Jun 24 10:20:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:31.705658 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c75b-0474-415a-8a5c-68e058937763 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:31.706164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c75b-0474-415a-8a5c-68e058937763 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:31.706240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c75b-0474-415a-8a5c-68e058937763 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:31.707840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 468/932] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:31.713669 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec23f6a-5a3a-4427-9018-19ae39670e45 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:31.714155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec23f6a-5a3a-4427-9018-19ae39670e45 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:31.714314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec23f6a-5a3a-4427-9018-19ae39670e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:31.731248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-9ec23f6a-5a3a-4427-9018-19ae39670e45 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:31.732428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9ec23f6a-5a3a-4427-9018-19ae39670e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:31.807010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 465/933] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:31.829881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c75b-0474-415a-8a5c-68e058937763 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:31.931929 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c75b-0474-415a-8a5c-68e058937763 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:31.934310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:31.966746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762e0d-7357-4088-81b3-9e7d8584130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:31.967545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762e0d-7357-4088-81b3-9e7d8584130a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:31.967821 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762e0d-7357-4088-81b3-9e7d8584130a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:31.968091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762e0d-7357-4088-81b3-9e7d8584130a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:31.978707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df762e0d-7357-4088-81b3-9e7d8584130a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-df762e0d-7357-4088-81b3-9e7d8584130a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:31.986913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:31.989103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:31.991162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 469/934] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Jun 24 10:20:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:31.995969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec23f6a-5a3a-4427-9018-19ae39670e45 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:32.080735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:32.097240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec23f6a-5a3a-4427-9018-19ae39670e45 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:32.133637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c648834-fce1-4786-addc-64c69d6191a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:32.134308 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c648834-fce1-4786-addc-64c69d6191a6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:32.134684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c648834-fce1-4786-addc-64c69d6191a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:32.134958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c648834-fce1-4786-addc-64c69d6191a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:32.135810 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c648834-fce1-4786-addc-64c69d6191a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:32.136118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c648834-fce1-4786-addc-64c69d6191a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:32.137480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c648834-fce1-4786-addc-64c69d6191a6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:32.146183 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 466/935] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Jun 24 10:20:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:32.151774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762e0d-7357-4088-81b3-9e7d8584130a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:32.261284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762e0d-7357-4088-81b3-9e7d8584130a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:32.296868 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4af37-979c-49ad-a4df-7cad899d3b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:32.298024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4af37-979c-49ad-a4df-7cad899d3b6f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:32.298303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4af37-979c-49ad-a4df-7cad899d3b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:32.298606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4af37-979c-49ad-a4df-7cad899d3b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:32.310347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4af37-979c-49ad-a4df-7cad899d3b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:32.311823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4af37-979c-49ad-a4df-7cad899d3b6f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-62b4af37-979c-49ad-a4df-7cad899d3b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:32.329889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:32.332167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:32.334236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:32.334236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:32.334236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:32.334236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:32.334236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 470/936] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:32.339497 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c648834-fce1-4786-addc-64c69d6191a6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:32.447017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c648834-fce1-4786-addc-64c69d6191a6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:32.481297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e942-8218-491b-841a-d08ad5a519e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:32.481997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e942-8218-491b-841a-d08ad5a519e3 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:32.482279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e942-8218-491b-841a-d08ad5a519e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:32.482585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e942-8218-491b-841a-d08ad5a519e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:32.483386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e942-8218-491b-841a-d08ad5a519e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:32.483695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e942-8218-491b-841a-d08ad5a519e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:32.485087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e942-8218-491b-841a-d08ad5a519e3 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:32.499085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 467/937] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:32.504276 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4af37-979c-49ad-a4df-7cad899d3b6f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:32.529694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:32.583978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832930b5-c8d7-4350-971a-65a06f27b014 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:32.584240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832930b5-c8d7-4350-971a-65a06f27b014 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:32.584467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832930b5-c8d7-4350-971a-65a06f27b014 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:32.586544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 468/938] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:32.591767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209934-c3e2-4251-bebc-07953457eb73 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:32.592060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209934-c3e2-4251-bebc-07953457eb73 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:32.592340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209934-c3e2-4251-bebc-07953457eb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:32.610722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:32.617040 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5e209934-c3e2-4251-bebc-07953457eb73 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:32.619097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5e209934-c3e2-4251-bebc-07953457eb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:32.634303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4af37-979c-49ad-a4df-7cad899d3b6f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:32.668831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0625fd-34dd-4a79-ac29-0c16b8b6fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:32.669978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0625fd-34dd-4a79-ac29-0c16b8b6fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:32.670523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0625fd-34dd-4a79-ac29-0c16b8b6fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:32.671004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0625fd-34dd-4a79-ac29-0c16b8b6fcb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:32.683852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0625fd-34dd-4a79-ac29-0c16b8b6fcb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:32.685573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0625fd-34dd-4a79-ac29-0c16b8b6fcb4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:32.703865 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 469/939] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-7a0625fd-34dd-4a79-ac29-0c16b8b6fcb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:32.705249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:32.706606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:32.707549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:32.707549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:32.707549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:32.707549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:32.707549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:32.707549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:32.707549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:32.707549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:32.707549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:32.707549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:32.710480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 471/940] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Jun 24 10:20:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:32.720023 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e209934-c3e2-4251-bebc-07953457eb73 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:32.732136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0625fd-34dd-4a79-ac29-0c16b8b6fcb4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:32.828548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e209934-c3e2-4251-bebc-07953457eb73 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:32.832069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:32.862398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0625fd-34dd-4a79-ac29-0c16b8b6fcb4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:32.870317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57410d67-5bd7-454e-9abc-9d97f225a246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:32.871532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57410d67-5bd7-454e-9abc-9d97f225a246 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:32.871821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57410d67-5bd7-454e-9abc-9d97f225a246 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:32.872099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57410d67-5bd7-454e-9abc-9d97f225a246 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:32.872936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57410d67-5bd7-454e-9abc-9d97f225a246 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:32.873245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57410d67-5bd7-454e-9abc-9d97f225a246 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:32.875112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57410d67-5bd7-454e-9abc-9d97f225a246 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:32.880066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:32.902398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 470/941] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Jun 24 10:20:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:32.907528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57410d67-5bd7-454e-9abc-9d97f225a246 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:32.909588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:32.910632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:32.911103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:32.911685 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:32.912600 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:32.914268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:32.915891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WARNING keystone.server.flask.common [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 10:20:32.936856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.sql.core [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 10:20:32.936856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 10:20:32.936856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [parameters: {'id': '26ff4214ca8f4bd3ab88d6b834ff8b0c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 10:20:32.936856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80113) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 26ff4214ca8f4bd3ab88d6b834ff8b0c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 26ff4214ca8f4bd3ab88d6b834ff8b0c. Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:20:32.961850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result.read() Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 10:20:32.962819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application yield resource Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise self.value Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application session.commit() Jun 24 10:20:32.963786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.session.flush() Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application compat.raise_( Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 10:20:32.964666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 10:20:32.965590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result.read() Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:20:32.966417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [parameters: {'id': '26ff4214ca8f4bd3ab88d6b834ff8b0c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:32.967296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:32.968116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:32.969077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:32.969077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 10:20:32.969077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 10:20:32.969077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:32.969077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:32.969077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 10:20:32.969077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 10:20:32.969077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 26ff4214ca8f4bd3ab88d6b834ff8b0c. Jun 24 10:20:32.969077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:32.969077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 472/942] 10.222.0.44 () {60 vars in 1140 bytes} [Fri Jun 24 10:20:32 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:32.971698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:33.030029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57410d67-5bd7-454e-9abc-9d97f225a246 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:33.073822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c61452-f556-4306-8ca2-c76140f3905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:33.074686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c61452-f556-4306-8ca2-c76140f3905e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.074971 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c61452-f556-4306-8ca2-c76140f3905e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.075243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c61452-f556-4306-8ca2-c76140f3905e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.088798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c61452-f556-4306-8ca2-c76140f3905e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:33.091421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c61452-f556-4306-8ca2-c76140f3905e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:33.114365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c4a8-1dc1-4f48-ba9c-3b257aa03365 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-31c61452-f556-4306-8ca2-c76140f3905e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:33.118163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:33.119087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:33.119986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:33.119986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:33.119986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:33.119986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:33.126784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 471/943] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:33.127965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c61452-f556-4306-8ca2-c76140f3905e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:33.149864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:33.156142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c11d6-a7c9-487e-9a0e-40bbf546ae51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:33.157404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c11d6-a7c9-487e-9a0e-40bbf546ae51 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.158025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c11d6-a7c9-487e-9a0e-40bbf546ae51 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.158705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c11d6-a7c9-487e-9a0e-40bbf546ae51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.166502 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c11d6-a7c9-487e-9a0e-40bbf546ae51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:33.168135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c11d6-a7c9-487e-9a0e-40bbf546ae51 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:33.177964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-aa9c11d6-a7c9-487e-9a0e-40bbf546ae51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:33.183294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:33.184193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 473/944] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab7cfc-84de-43ca-bd69-e378101cc70f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.190391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab7cfc-84de-43ca-bd69-e378101cc70f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.191000 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab7cfc-84de-43ca-bd69-e378101cc70f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.194720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 474/945] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:33.195538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab7cfc-84de-43ca-bd69-e378101cc70f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:33.246843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c61452-f556-4306-8ca2-c76140f3905e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:33.284363 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46d68e-5661-494a-8912-6fd428fc0208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:33.285069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46d68e-5661-494a-8912-6fd428fc0208 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.285623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46d68e-5661-494a-8912-6fd428fc0208 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.285931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46d68e-5661-494a-8912-6fd428fc0208 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.286783 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46d68e-5661-494a-8912-6fd428fc0208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:33.287148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46d68e-5661-494a-8912-6fd428fc0208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:33.289246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46d68e-5661-494a-8912-6fd428fc0208 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:33.306731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 472/946] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:33.306731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f604-1608-49d7-a908-31b7c79f2bf0 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.306731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f604-1608-49d7-a908-31b7c79f2bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.306731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f604-1608-49d7-a908-31b7c79f2bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.318366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab7cfc-84de-43ca-bd69-e378101cc70f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:33.320698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-9ab4f604-1608-49d7-a908-31b7c79f2bf0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:33.321882 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9ab4f604-1608-49d7-a908-31b7c79f2bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:33.357099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ce0e3-33cc-4ed3-9a66-778bb41ce903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:33.357846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ce0e3-33cc-4ed3-9a66-778bb41ce903 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.358131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ce0e3-33cc-4ed3-9a66-778bb41ce903 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.358443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ce0e3-33cc-4ed3-9a66-778bb41ce903 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.359203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ce0e3-33cc-4ed3-9a66-778bb41ce903 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:33.359511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ce0e3-33cc-4ed3-9a66-778bb41ce903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:33.360945 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ce0e3-33cc-4ed3-9a66-778bb41ce903 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:33.386481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 475/947] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:33.386481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ce0e3-33cc-4ed3-9a66-778bb41ce903 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:33.401778 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 473/948] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:33.426113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4f604-1608-49d7-a908-31b7c79f2bf0 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:33.456134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:33.463975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:33.514091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ce0e3-33cc-4ed3-9a66-778bb41ce903 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:33.536575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4f604-1608-49d7-a908-31b7c79f2bf0 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:33.553182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c25c7-46f8-41cd-b31b-f2af316146b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:33.553997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c25c7-46f8-41cd-b31b-f2af316146b4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.554285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c25c7-46f8-41cd-b31b-f2af316146b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.554593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c25c7-46f8-41cd-b31b-f2af316146b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.565062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c25c7-46f8-41cd-b31b-f2af316146b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:33.566574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c25c7-46f8-41cd-b31b-f2af316146b4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:33.579999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b314ac-f308-47d2-a539-463feb2989c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:33.580800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b314ac-f308-47d2-a539-463feb2989c1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.581081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b314ac-f308-47d2-a539-463feb2989c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.581356 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b314ac-f308-47d2-a539-463feb2989c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.582147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b314ac-f308-47d2-a539-463feb2989c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:33.583589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b314ac-f308-47d2-a539-463feb2989c1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-221c25c7-46f8-41cd-b31b-f2af316146b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:33.584715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:33.586110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:33.587109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:33.587109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:33.587109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:33.587109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:33.587109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:33.587109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:33.587109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:33.587109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:33.587109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 476/949] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:33.587808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a6a5-b46d-436f-996b-4bef250475b3 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.588511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a6a5-b46d-436f-996b-4bef250475b3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.588511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a6a5-b46d-436f-996b-4bef250475b3 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.590393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 477/950] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:33.593472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183a6a5-b46d-436f-996b-4bef250475b3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-96b314ac-f308-47d2-a539-463feb2989c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:33.598835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:33.600388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:33.602936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 474/951] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:33.604747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b4f1-8839-4be6-ab97-7a97565ecd1c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.604747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b4f1-8839-4be6-ab97-7a97565ecd1c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.604747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b4f1-8839-4be6-ab97-7a97565ecd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.621031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-39f4b4f1-8839-4be6-ab97-7a97565ecd1c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:33.623095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-39f4b4f1-8839-4be6-ab97-7a97565ecd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:33.692887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 475/952] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:33.693545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b4f1-8839-4be6-ab97-7a97565ecd1c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:33.716188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183a6a5-b46d-436f-996b-4bef250475b3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:33.729590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:33.739552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:33.751982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9fa2f-20ee-44a9-b1ec-d93f6275062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:33.752643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9fa2f-20ee-44a9-b1ec-d93f6275062b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.752925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9fa2f-20ee-44a9-b1ec-d93f6275062b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.753204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9fa2f-20ee-44a9-b1ec-d93f6275062b None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.753987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9fa2f-20ee-44a9-b1ec-d93f6275062b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:33.754296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9fa2f-20ee-44a9-b1ec-d93f6275062b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:33.755754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9fa2f-20ee-44a9-b1ec-d93f6275062b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:33.769075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 478/953] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:33.769889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9fa2f-20ee-44a9-b1ec-d93f6275062b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:33.825100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b4f1-8839-4be6-ab97-7a97565ecd1c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:33.860586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af54704-e4e3-47ce-a339-2fb6b0014909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:33.861252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54704-e4e3-47ce-a339-2fb6b0014909 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.861649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54704-e4e3-47ce-a339-2fb6b0014909 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.861968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af54704-e4e3-47ce-a339-2fb6b0014909 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.862821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af54704-e4e3-47ce-a339-2fb6b0014909 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:33.863178 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af54704-e4e3-47ce-a339-2fb6b0014909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:33.865030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af54704-e4e3-47ce-a339-2fb6b0014909 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:33.875191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 476/954] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Jun 24 10:20:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:33.875191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af54704-e4e3-47ce-a339-2fb6b0014909 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:33.882606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9fa2f-20ee-44a9-b1ec-d93f6275062b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:33.919214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab246ed5-3520-4304-b279-e777a0f8ef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:33.920015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab246ed5-3520-4304-b279-e777a0f8ef29 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:33.920300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab246ed5-3520-4304-b279-e777a0f8ef29 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:33.920580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab246ed5-3520-4304-b279-e777a0f8ef29 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:33.921236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab246ed5-3520-4304-b279-e777a0f8ef29 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:33.922901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab246ed5-3520-4304-b279-e777a0f8ef29 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ab246ed5-3520-4304-b279-e777a0f8ef29 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:33.934481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:33.935588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:33.936485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 479/955] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:33.937399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab246ed5-3520-4304-b279-e777a0f8ef29 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:33.976755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:33.984165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:33.994089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af54704-e4e3-47ce-a339-2fb6b0014909 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:34.031588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd741e0-553e-458c-bd9f-9d89f3f74262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:34.032467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd741e0-553e-458c-bd9f-9d89f3f74262 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:34.032750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd741e0-553e-458c-bd9f-9d89f3f74262 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:34.033022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd741e0-553e-458c-bd9f-9d89f3f74262 None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/f75e1cb00d8b44988b660c753d498f77/roles/a36632e7ea7d4cbc904c35edc9e13bec` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:34.035645 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd741e0-553e-458c-bd9f-9d89f3f74262 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=f75e1cb00d8b44988b660c753d498f77, role_id=a36632e7ea7d4cbc904c35edc9e13bec)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:34.037326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd741e0-553e-458c-bd9f-9d89f3f74262 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:34.042781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab246ed5-3520-4304-b279-e777a0f8ef29 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:34.058383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 477/956] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:20:33 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/f75e1cb00d8b44988b660c753d498f77/roles/a36632e7ea7d4cbc904c35edc9e13bec => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:20:34.058383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd741e0-553e-458c-bd9f-9d89f3f74262 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:34.103000 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013f5de-25c2-44ba-b778-a820358c8476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:34.103844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013f5de-25c2-44ba-b778-a820358c8476 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:34.104208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013f5de-25c2-44ba-b778-a820358c8476 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:34.104568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013f5de-25c2-44ba-b778-a820358c8476 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:34.105426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013f5de-25c2-44ba-b778-a820358c8476 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:34.105809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013f5de-25c2-44ba-b778-a820358c8476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:34.107349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013f5de-25c2-44ba-b778-a820358c8476 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:34.115891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 480/957] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Jun 24 10:20:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:34.122370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013f5de-25c2-44ba-b778-a820358c8476 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:34.183790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd741e0-553e-458c-bd9f-9d89f3f74262 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:34.232289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094c7a2-89d1-4262-b7f9-3c2b7955774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:34.232965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094c7a2-89d1-4262-b7f9-3c2b7955774b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:34.233250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094c7a2-89d1-4262-b7f9-3c2b7955774b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:34.233527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094c7a2-89d1-4262-b7f9-3c2b7955774b None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:34.234425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094c7a2-89d1-4262-b7f9-3c2b7955774b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:34.234676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094c7a2-89d1-4262-b7f9-3c2b7955774b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:34.236169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094c7a2-89d1-4262-b7f9-3c2b7955774b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:34.242207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 478/958] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:34.247006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:34.248495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094c7a2-89d1-4262-b7f9-3c2b7955774b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:34.251796 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013f5de-25c2-44ba-b778-a820358c8476 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:34.270203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:34.294306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04578a85-2e29-40b5-9184-9b1280adb651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:34.295155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578a85-2e29-40b5-9184-9b1280adb651 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:34.295432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578a85-2e29-40b5-9184-9b1280adb651 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:34.295714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04578a85-2e29-40b5-9184-9b1280adb651 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:34.297547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04578a85-2e29-40b5-9184-9b1280adb651 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:34.298958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04578a85-2e29-40b5-9184-9b1280adb651 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:34.327294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 481/959] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Jun 24 10:20:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:34.390552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094c7a2-89d1-4262-b7f9-3c2b7955774b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:34.443455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5091d-11dd-4f9f-ad1b-967ef0303639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:34.444132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5091d-11dd-4f9f-ad1b-967ef0303639 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:34.444412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5091d-11dd-4f9f-ad1b-967ef0303639 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:34.445273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5091d-11dd-4f9f-ad1b-967ef0303639 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:34.445986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5091d-11dd-4f9f-ad1b-967ef0303639 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:34.446290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5091d-11dd-4f9f-ad1b-967ef0303639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:34.447850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5091d-11dd-4f9f-ad1b-967ef0303639 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:34.454395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 479/960] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:35.570037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed310f-8603-4b3d-b31b-67410d02294c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:35.570624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed310f-8603-4b3d-b31b-67410d02294c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:35.570624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed310f-8603-4b3d-b31b-67410d02294c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:35.573158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 482/961] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:35.578117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61ce6-aacf-408b-a8e4-f4d3d8250d80 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:35.578693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61ce6-aacf-408b-a8e4-f4d3d8250d80 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:35.578773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61ce6-aacf-408b-a8e4-f4d3d8250d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:35.597946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-56a61ce6-aacf-408b-a8e4-f4d3d8250d80 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:35.599499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-56a61ce6-aacf-408b-a8e4-f4d3d8250d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:35.674502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 480/962] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:35.694222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed310f-8603-4b3d-b31b-67410d02294c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:35.800923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed310f-8603-4b3d-b31b-67410d02294c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:35.836043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622454-9082-4f96-b9fa-3cef4cc2586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:35.836641 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622454-9082-4f96-b9fa-3cef4cc2586d None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:35.836928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622454-9082-4f96-b9fa-3cef4cc2586d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:35.837209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622454-9082-4f96-b9fa-3cef4cc2586d None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:35.837922 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62622454-9082-4f96-b9fa-3cef4cc2586d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:35.839554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62622454-9082-4f96-b9fa-3cef4cc2586d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:35.853568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.sql.core [None req-62622454-9082-4f96-b9fa-3cef4cc2586d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 10:20:35.853568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 10:20:35.853568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [parameters: {'user_id': 'ac4f15006b284d6b8fd503215e89e6e3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 10:20:35.853568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80113) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-62622454-9082-4f96-b9fa-3cef4cc2586d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result.read() Jun 24 10:20:35.861135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:20:35.862009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application yield resource Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application next(self.gen) Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise self.value Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application session.commit() Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 10:20:35.863239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.session.flush() Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application compat.raise_( Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 10:20:35.864268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 10:20:35.865192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application conn.query(q) Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application result.read() Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 10:20:35.866061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ac4f15006b284d6b8fd503215e89e6e3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:35.867019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 10:20:35.867916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 10:20:35.868867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 10:20:35.868867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 10:20:35.868867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 10:20:35.868867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 10:20:35.868867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 10:20:35.868867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:35.868867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 483/963] 10.222.0.44 () {60 vars in 1131 bytes} [Fri Jun 24 10:20:35 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:35.878400 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a61ce6-aacf-408b-a8e4-f4d3d8250d80 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:35.902725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:35.980394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a61ce6-aacf-408b-a8e4-f4d3d8250d80 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:36.015733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60006384-6c61-4fe7-9cd0-0df9d57a8493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:36.016901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60006384-6c61-4fe7-9cd0-0df9d57a8493 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.017391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60006384-6c61-4fe7-9cd0-0df9d57a8493 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.017869 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60006384-6c61-4fe7-9cd0-0df9d57a8493 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.025891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60006384-6c61-4fe7-9cd0-0df9d57a8493 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:36.027613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60006384-6c61-4fe7-9cd0-0df9d57a8493 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-60006384-6c61-4fe7-9cd0-0df9d57a8493 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:36.042662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:36.043638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:36.044670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:36.044670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:36.044670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:36.044670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:36.044670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:36.044670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:36.044670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:36.044670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:36.044670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 10:20:36.044670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:36.051937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 481/964] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:36.053739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622454-9082-4f96-b9fa-3cef4cc2586d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:36.075111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:36.163045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622454-9082-4f96-b9fa-3cef4cc2586d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:36.202408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50ae4f-bf50-421f-a2fb-ffc6e0d2a4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:36.203100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50ae4f-bf50-421f-a2fb-ffc6e0d2a4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.203389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50ae4f-bf50-421f-a2fb-ffc6e0d2a4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.203674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50ae4f-bf50-421f-a2fb-ffc6e0d2a4f8 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.204488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50ae4f-bf50-421f-a2fb-ffc6e0d2a4f8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:36.204801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50ae4f-bf50-421f-a2fb-ffc6e0d2a4f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:36.206489 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50ae4f-bf50-421f-a2fb-ffc6e0d2a4f8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:36.251193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 484/965] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Jun 24 10:20:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:36.260411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143b1c6-e2d5-48ba-8d60-595dce9992b5 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.260719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143b1c6-e2d5-48ba-8d60-595dce9992b5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.260980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143b1c6-e2d5-48ba-8d60-595dce9992b5 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.262648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 482/966] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:36.268222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbbd08-17ff-491e-b8ff-c6ebf38d0b8d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.268517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbbd08-17ff-491e-b8ff-c6ebf38d0b8d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.268799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbbd08-17ff-491e-b8ff-c6ebf38d0b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.288118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-28fbbd08-17ff-491e-b8ff-c6ebf38d0b8d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:36.289778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-28fbbd08-17ff-491e-b8ff-c6ebf38d0b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:36.368121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 485/967] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:36.392455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143b1c6-e2d5-48ba-8d60-595dce9992b5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:36.449869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14435-dbe6-4d17-8aad-21cc5effa051 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.450163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14435-dbe6-4d17-8aad-21cc5effa051 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.450401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14435-dbe6-4d17-8aad-21cc5effa051 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.451978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 486/968] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:36.459653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4b6e6-9b30-4b5f-9269-2e41d2dbc31e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.459939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4b6e6-9b30-4b5f-9269-2e41d2dbc31e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.460255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4b6e6-9b30-4b5f-9269-2e41d2dbc31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.473105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:36.475888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:36.485634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3be4b6e6-9b30-4b5f-9269-2e41d2dbc31e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:36.487562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3be4b6e6-9b30-4b5f-9269-2e41d2dbc31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:36.524187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143b1c6-e2d5-48ba-8d60-595dce9992b5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:36.564520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586686a-b756-46f5-b4f8-ab44a037be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:36.565705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586686a-b756-46f5-b4f8-ab44a037be51 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.566102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586686a-b756-46f5-b4f8-ab44a037be51 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.566402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586686a-b756-46f5-b4f8-ab44a037be51 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.574430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 487/969] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:36.575768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a4e11-b82c-41ef-8c08-f4ee2782d59f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.576062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a4e11-b82c-41ef-8c08-f4ee2782d59f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.576365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a4e11-b82c-41ef-8c08-f4ee2782d59f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.577769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 488/970] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:36.577875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586686a-b756-46f5-b4f8-ab44a037be51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:36.582789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26070e-7a62-4955-a549-ff1ecb370d6b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.583084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26070e-7a62-4955-a549-ff1ecb370d6b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.583367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26070e-7a62-4955-a549-ff1ecb370d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b586686a-b756-46f5-b4f8-ab44a037be51 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:36.585924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:36.587416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:36.588289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 483/971] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Jun 24 10:20:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:36.593384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586686a-b756-46f5-b4f8-ab44a037be51 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:36.602304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ea26070e-7a62-4955-a549-ff1ecb370d6b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:36.603505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ea26070e-7a62-4955-a549-ff1ecb370d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:36.668976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 489/972] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:36.669796 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26070e-7a62-4955-a549-ff1ecb370d6b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:36.694291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586686a-b756-46f5-b4f8-ab44a037be51 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:36.720507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:36.729234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55700064-766e-419e-a086-3b54d4b83d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:36.729934 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700064-766e-419e-a086-3b54d4b83d19 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.730228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700064-766e-419e-a086-3b54d4b83d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.730542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55700064-766e-419e-a086-3b54d4b83d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.731292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55700064-766e-419e-a086-3b54d4b83d19 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:36.731601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55700064-766e-419e-a086-3b54d4b83d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:36.732970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55700064-766e-419e-a086-3b54d4b83d19 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:36.739416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:36.740919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 484/973] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Jun 24 10:20:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:36.741766 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55700064-766e-419e-a086-3b54d4b83d19 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:36.774214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26070e-7a62-4955-a549-ff1ecb370d6b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:36.808313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105206-d09e-4b01-87b6-dcbf00b7f768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:36.809103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105206-d09e-4b01-87b6-dcbf00b7f768 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.809386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105206-d09e-4b01-87b6-dcbf00b7f768 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.809658 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105206-d09e-4b01-87b6-dcbf00b7f768 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.810306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54105206-d09e-4b01-87b6-dcbf00b7f768 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:36.811737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54105206-d09e-4b01-87b6-dcbf00b7f768 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-54105206-d09e-4b01-87b6-dcbf00b7f768 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:36.823296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:36.824424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:36.825280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 490/974] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:36.826090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105206-d09e-4b01-87b6-dcbf00b7f768 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:36.846773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55700064-766e-419e-a086-3b54d4b83d19 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:36.880205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9351b-3a4f-463c-9f5c-9cc578d10426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:36.880856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9351b-3a4f-463c-9f5c-9cc578d10426 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.881133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9351b-3a4f-463c-9f5c-9cc578d10426 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.881407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9351b-3a4f-463c-9f5c-9cc578d10426 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:36.882134 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9351b-3a4f-463c-9f5c-9cc578d10426 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:36.883503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9351b-3a4f-463c-9f5c-9cc578d10426 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:36.896059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 485/975] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:20:36 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:36.896861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9351b-3a4f-463c-9f5c-9cc578d10426 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:36.934450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105206-d09e-4b01-87b6-dcbf00b7f768 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:36.950824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:36.968897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:36.987443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a5c8-8805-4a55-8b45-916183328583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:36.988906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a5c8-8805-4a55-8b45-916183328583 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:36.989209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a5c8-8805-4a55-8b45-916183328583 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:36.989487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a5c8-8805-4a55-8b45-916183328583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:37.005438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632a5c8-8805-4a55-8b45-916183328583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:37.007011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632a5c8-8805-4a55-8b45-916183328583 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:37.007355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9351b-3a4f-463c-9f5c-9cc578d10426 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e632a5c8-8805-4a55-8b45-916183328583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:37.028664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:37.029735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:37.030702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:37.030702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:37.030702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:37.030702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:37.031458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 491/976] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:37.036700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a5c8-8805-4a55-8b45-916183328583 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:37.049033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d37449-c82f-496f-9744-8ba0a1af9e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:37.049703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37449-c82f-496f-9744-8ba0a1af9e39 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:37.049987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37449-c82f-496f-9744-8ba0a1af9e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:37.050261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37449-c82f-496f-9744-8ba0a1af9e39 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:37.051269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d37449-c82f-496f-9744-8ba0a1af9e39 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:37.051385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d37449-c82f-496f-9744-8ba0a1af9e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:37.052997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d37449-c82f-496f-9744-8ba0a1af9e39 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:37.058305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 486/977] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Jun 24 10:20:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:37.064264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d37449-c82f-496f-9744-8ba0a1af9e39 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:37.160619 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a5c8-8805-4a55-8b45-916183328583 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:37.170098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d37449-c82f-496f-9744-8ba0a1af9e39 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:37.185694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:37.197797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d23c7-f43a-41e0-8f15-974d78c7f6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:37.198495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d23c7-f43a-41e0-8f15-974d78c7f6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:37.198786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d23c7-f43a-41e0-8f15-974d78c7f6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:37.199060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d23c7-f43a-41e0-8f15-974d78c7f6a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:37.199783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d23c7-f43a-41e0-8f15-974d78c7f6a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:37.200090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d23c7-f43a-41e0-8f15-974d78c7f6a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:37.201454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d23c7-f43a-41e0-8f15-974d78c7f6a2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:37.207298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad6b9c-f4c3-4474-b431-13d4093af24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:37.207972 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad6b9c-f4c3-4474-b431-13d4093af24b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:37.208315 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad6b9c-f4c3-4474-b431-13d4093af24b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:37.208594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad6b9c-f4c3-4474-b431-13d4093af24b None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:37.209302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad6b9c-f4c3-4474-b431-13d4093af24b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:37.209614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad6b9c-f4c3-4474-b431-13d4093af24b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:37.211027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad6b9c-f4c3-4474-b431-13d4093af24b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:37.219209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 492/978] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:37.219398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 487/979] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Jun 24 10:20:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:37.221473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d23c7-f43a-41e0-8f15-974d78c7f6a2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:37.221582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad6b9c-f4c3-4474-b431-13d4093af24b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:37.276614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:37.334685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad6b9c-f4c3-4474-b431-13d4093af24b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:37.345921 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d23c7-f43a-41e0-8f15-974d78c7f6a2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:37.373623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a415c2-40b7-470e-b83b-f98cd449070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:37.374279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a415c2-40b7-470e-b83b-f98cd449070c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:37.374586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a415c2-40b7-470e-b83b-f98cd449070c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:37.376695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a415c2-40b7-470e-b83b-f98cd449070c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:37.376695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a415c2-40b7-470e-b83b-f98cd449070c None admin] RBAC: Adding query filter params (interface=admin, service_id=d947160acfb94554b31a053afc042555, region_id=RegionOne) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:37.376695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a415c2-40b7-470e-b83b-f98cd449070c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:37.377309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a415c2-40b7-470e-b83b-f98cd449070c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:37.383182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 488/980] 10.222.0.44 () {56 vars in 1249 bytes} [Fri Jun 24 10:20:37 2022] GET /identity/v3/endpoints?service_id=d947160acfb94554b31a053afc042555&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:37.383535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821adbb-4a3e-406f-9e6d-ae42ec05ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:37.384346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821adbb-4a3e-406f-9e6d-ae42ec05ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:37.384631 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821adbb-4a3e-406f-9e6d-ae42ec05ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:37.384904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821adbb-4a3e-406f-9e6d-ae42ec05ecc3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:37.388483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a415c2-40b7-470e-b83b-f98cd449070c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:37.393227 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821adbb-4a3e-406f-9e6d-ae42ec05ecc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:37.394704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821adbb-4a3e-406f-9e6d-ae42ec05ecc3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c821adbb-4a3e-406f-9e6d-ae42ec05ecc3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:37.410191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:37.411236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:37.412207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 493/981] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Jun 24 10:20:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:37.417484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821adbb-4a3e-406f-9e6d-ae42ec05ecc3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:37.437741 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:37.499350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a415c2-40b7-470e-b83b-f98cd449070c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:37.527400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:37.531897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821adbb-4a3e-406f-9e6d-ae42ec05ecc3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:37.537411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c26dbe-7923-4511-a092-e93ebeb460b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:37.538616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26dbe-7923-4511-a092-e93ebeb460b0 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:37.538915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26dbe-7923-4511-a092-e93ebeb460b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:37.539195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26dbe-7923-4511-a092-e93ebeb460b0 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:37.539881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c26dbe-7923-4511-a092-e93ebeb460b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:37.541687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c26dbe-7923-4511-a092-e93ebeb460b0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:37.549286 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 489/982] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Jun 24 10:20:37 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:20:37.575384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e600350-dbe6-42a5-baee-88a9e897593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:37.575752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e600350-dbe6-42a5-baee-88a9e897593b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:37.575985 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e600350-dbe6-42a5-baee-88a9e897593b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:37.576220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e600350-dbe6-42a5-baee-88a9e897593b None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:37.577086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e600350-dbe6-42a5-baee-88a9e897593b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:37.577404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e600350-dbe6-42a5-baee-88a9e897593b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:37.578950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e600350-dbe6-42a5-baee-88a9e897593b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:37.604075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 494/983] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Jun 24 10:20:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:37.605256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c26dbe-7923-4511-a092-e93ebeb460b0 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:37.715265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c26dbe-7923-4511-a092-e93ebeb460b0 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:37.722121 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:37.749686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7f677-7ec7-42c9-96e0-009ea165c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:37.750342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7f677-7ec7-42c9-96e0-009ea165c517 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:37.750683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7f677-7ec7-42c9-96e0-009ea165c517 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:37.750959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7f677-7ec7-42c9-96e0-009ea165c517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:37.820252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7f677-7ec7-42c9-96e0-009ea165c517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:37.821599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7f677-7ec7-42c9-96e0-009ea165c517 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:37.922879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 490/984] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:37 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 10:20:37.924856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e600350-dbe6-42a5-baee-88a9e897593b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:38.029062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e600350-dbe6-42a5-baee-88a9e897593b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:38.064419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc37b9-791f-482a-8b8e-44b21a1df349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:38.065211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc37b9-791f-482a-8b8e-44b21a1df349 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:38.065505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc37b9-791f-482a-8b8e-44b21a1df349 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:38.065782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc37b9-791f-482a-8b8e-44b21a1df349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:38.076645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc37b9-791f-482a-8b8e-44b21a1df349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:38.078033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc37b9-791f-482a-8b8e-44b21a1df349 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-e1dc37b9-791f-482a-8b8e-44b21a1df349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:38.095319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:38.096218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:38.097129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:38.097129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:38.097129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:38.097129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:38.098681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 495/985] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:38.102030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7f677-7ec7-42c9-96e0-009ea165c517 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:38.110644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:38.202812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7f677-7ec7-42c9-96e0-009ea165c517 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:38.235887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c37580-35ce-4b59-95d2-8ed6d11d6a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:38.236545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c37580-35ce-4b59-95d2-8ed6d11d6a6e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:38.236828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c37580-35ce-4b59-95d2-8ed6d11d6a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:38.237101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c37580-35ce-4b59-95d2-8ed6d11d6a6e None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:38.237808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c37580-35ce-4b59-95d2-8ed6d11d6a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:38.238108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c37580-35ce-4b59-95d2-8ed6d11d6a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:38.239486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c37580-35ce-4b59-95d2-8ed6d11d6a6e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:38.255608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 491/986] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:38.257543 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc37b9-791f-482a-8b8e-44b21a1df349 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:38.268979 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:38.362096 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc37b9-791f-482a-8b8e-44b21a1df349 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:38.395561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43cd1a-af77-4639-b4e9-8078483d9ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:38.396349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43cd1a-af77-4639-b4e9-8078483d9ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:38.396634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43cd1a-af77-4639-b4e9-8078483d9ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:38.396912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43cd1a-af77-4639-b4e9-8078483d9ee2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:38.404055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43cd1a-af77-4639-b4e9-8078483d9ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:38.405497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43cd1a-af77-4639-b4e9-8078483d9ee2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-db43cd1a-af77-4639-b4e9-8078483d9ee2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:38.419090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:38.420043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:38.421030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:38.421030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:38.421030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:38.421030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:38.421030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:38.421030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:38.421030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:38.421030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:38.422668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 496/987] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:38.426327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c37580-35ce-4b59-95d2-8ed6d11d6a6e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:38.493555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:38.531458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c37580-35ce-4b59-95d2-8ed6d11d6a6e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:38.572825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ca0de-7ab0-4422-a258-ea78da7d924e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:38.573496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ca0de-7ab0-4422-a258-ea78da7d924e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:38.573785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ca0de-7ab0-4422-a258-ea78da7d924e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:38.574066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ca0de-7ab0-4422-a258-ea78da7d924e None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:38.574886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ca0de-7ab0-4422-a258-ea78da7d924e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:38.575201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ca0de-7ab0-4422-a258-ea78da7d924e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:38.576629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ca0de-7ab0-4422-a258-ea78da7d924e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:38.594692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 492/988] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:38.595996 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43cd1a-af77-4639-b4e9-8078483d9ee2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:38.665537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:38.702909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43cd1a-af77-4639-b4e9-8078483d9ee2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:38.736663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a2697-9feb-433c-b893-a9563969d9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:38.737324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a2697-9feb-433c-b893-a9563969d9ee None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:38.737609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a2697-9feb-433c-b893-a9563969d9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:38.737886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a2697-9feb-433c-b893-a9563969d9ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:38.738818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a2697-9feb-433c-b893-a9563969d9ee None admin] RBAC: Adding query filter params (role.id=a36632e7ea7d4cbc904c35edc9e13bec, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=f75e1cb00d8b44988b660c753d498f77) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:38.739137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a2697-9feb-433c-b893-a9563969d9ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:38.740578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a2697-9feb-433c-b893-a9563969d9ee None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:38.754456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 497/989] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:38 2022] GET /identity/v3/role_assignments?user.id=f75e1cb00d8b44988b660c753d498f77&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=a36632e7ea7d4cbc904c35edc9e13bec => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:38.955429 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522478-3634-4fd1-a4a9-c412d5f95c50 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:38.955921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522478-3634-4fd1-a4a9-c412d5f95c50 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:38.956019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522478-3634-4fd1-a4a9-c412d5f95c50 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:38.957380 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 493/990] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:38.962704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75928-7272-406e-967c-da78ae69c3b2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:38.963013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75928-7272-406e-967c-da78ae69c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:38.963279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75928-7272-406e-967c-da78ae69c3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:38.980238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-59f75928-7272-406e-967c-da78ae69c3b2 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:38.981423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-59f75928-7272-406e-967c-da78ae69c3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:39.049908 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 498/991] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:39.072975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75522478-3634-4fd1-a4a9-c412d5f95c50 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:39.176119 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75522478-3634-4fd1-a4a9-c412d5f95c50 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:39.202218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:39.211870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad6de0-0bb0-4194-ad06-a33b3b1eb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:39.212598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad6de0-0bb0-4194-ad06-a33b3b1eb659 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:39.212880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad6de0-0bb0-4194-ad06-a33b3b1eb659 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:39.213216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad6de0-0bb0-4194-ad06-a33b3b1eb659 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:39.213859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad6de0-0bb0-4194-ad06-a33b3b1eb659 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:39.215297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad6de0-0bb0-4194-ad06-a33b3b1eb659 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-74ad6de0-0bb0-4194-ad06-a33b3b1eb659 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:39.228227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:39.229227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:20:39.230066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:39.237455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 494/992] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:39.237602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f75928-7272-406e-967c-da78ae69c3b2 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:39.302648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:39.343493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f75928-7272-406e-967c-da78ae69c3b2 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:39.376952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5a5ff-bdaf-491e-a634-a87541efa018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:39.377615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5a5ff-bdaf-491e-a634-a87541efa018 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:39.377897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5a5ff-bdaf-491e-a634-a87541efa018 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:39.378169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5a5ff-bdaf-491e-a634-a87541efa018 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:39.378899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5a5ff-bdaf-491e-a634-a87541efa018 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:39.379202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5a5ff-bdaf-491e-a634-a87541efa018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:39.380570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5a5ff-bdaf-491e-a634-a87541efa018 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:39.390853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 499/993] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:39.391804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad6de0-0bb0-4194-ad06-a33b3b1eb659 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:39.493090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad6de0-0bb0-4194-ad06-a33b3b1eb659 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:39.525968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540a44b-83b8-4e93-aae9-a8de1d021484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:39.526652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a44b-83b8-4e93-aae9-a8de1d021484 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:39.526936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a44b-83b8-4e93-aae9-a8de1d021484 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:39.527209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a44b-83b8-4e93-aae9-a8de1d021484 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:39.527901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540a44b-83b8-4e93-aae9-a8de1d021484 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:39.528208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540a44b-83b8-4e93-aae9-a8de1d021484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:39.529550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540a44b-83b8-4e93-aae9-a8de1d021484 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:39.534560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 495/994] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:39.540664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5a5ff-bdaf-491e-a634-a87541efa018 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:39.635270 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9214d4-f173-47e3-8af9-31c7c8f45e55 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:39.635558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9214d4-f173-47e3-8af9-31c7c8f45e55 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:39.635825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9214d4-f173-47e3-8af9-31c7c8f45e55 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:39.637326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 496/995] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:39.641939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46229c47-a6c4-492f-8b76-8acfd45d7203 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:39.642233 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46229c47-a6c4-492f-8b76-8acfd45d7203 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:39.642544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46229c47-a6c4-492f-8b76-8acfd45d7203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:39.651586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5a5ff-bdaf-491e-a634-a87541efa018 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:39.659491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-46229c47-a6c4-492f-8b76-8acfd45d7203 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:39.660692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-46229c47-a6c4-492f-8b76-8acfd45d7203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:39.677930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:39.688880 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217029c-5cfb-46a1-845f-e6d35301d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:39.689533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217029c-5cfb-46a1-845f-e6d35301d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:39.689814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217029c-5cfb-46a1-845f-e6d35301d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:39.690087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217029c-5cfb-46a1-845f-e6d35301d8b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:39.690906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217029c-5cfb-46a1-845f-e6d35301d8b7 None admin] RBAC: Adding query filter params (interface=public, service_id=15765a09a5804d3c8c714cfb7750967e, region_id=RegionOne) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:39.691220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217029c-5cfb-46a1-845f-e6d35301d8b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:39.692573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217029c-5cfb-46a1-845f-e6d35301d8b7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:39.702738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 500/996] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Jun 24 10:20:39 2022] GET /identity/v3/endpoints?service_id=15765a09a5804d3c8c714cfb7750967e&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:39.703578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217029c-5cfb-46a1-845f-e6d35301d8b7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:39.712475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:39.730908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 497/997] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:39.754322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46229c47-a6c4-492f-8b76-8acfd45d7203 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:39.814537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217029c-5cfb-46a1-845f-e6d35301d8b7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:39.855299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846eaa7-9ab3-404a-9719-86d63b8f2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:39.856139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846eaa7-9ab3-404a-9719-86d63b8f2340 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:39.856752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846eaa7-9ab3-404a-9719-86d63b8f2340 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:39.857043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846eaa7-9ab3-404a-9719-86d63b8f2340 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:39.857889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846eaa7-9ab3-404a-9719-86d63b8f2340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:39.859309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846eaa7-9ab3-404a-9719-86d63b8f2340 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:39.862785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46229c47-a6c4-492f-8b76-8acfd45d7203 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:39.865946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 501/998] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Jun 24 10:20:39 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:20:39.907149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd872294-cff3-4084-9c91-4a7c7369b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:39.907979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872294-cff3-4084-9c91-4a7c7369b920 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:39.908264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872294-cff3-4084-9c91-4a7c7369b920 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:39.908543 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872294-cff3-4084-9c91-4a7c7369b920 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:39.909205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd872294-cff3-4084-9c91-4a7c7369b920 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:39.910625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd872294-cff3-4084-9c91-4a7c7369b920 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-bd872294-cff3-4084-9c91-4a7c7369b920 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:39.924613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:39.925693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 10:20:39.926985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:39.928085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 498/999] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Jun 24 10:20:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:39.932456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846eaa7-9ab3-404a-9719-86d63b8f2340 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:39.995352 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:40.044844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846eaa7-9ab3-404a-9719-86d63b8f2340 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:40.079123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7200a6-7649-4265-9221-f8d21f1802ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:40.079791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7200a6-7649-4265-9221-f8d21f1802ea None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:40.080079 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7200a6-7649-4265-9221-f8d21f1802ea None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:40.080358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7200a6-7649-4265-9221-f8d21f1802ea None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:40.081063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7200a6-7649-4265-9221-f8d21f1802ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:40.081369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7200a6-7649-4265-9221-f8d21f1802ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:40.082763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7200a6-7649-4265-9221-f8d21f1802ea None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:40.088052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 502/1000] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Jun 24 10:20:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:40.093632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd872294-cff3-4084-9c91-4a7c7369b920 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:40.145332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:40.199255 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd872294-cff3-4084-9c91-4a7c7369b920 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:40.233951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38ac1a-bbc7-4e52-a077-6df0a2edd8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:40.234648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38ac1a-bbc7-4e52-a077-6df0a2edd8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:40.234936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38ac1a-bbc7-4e52-a077-6df0a2edd8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:40.235213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38ac1a-bbc7-4e52-a077-6df0a2edd8e1 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:40.235913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38ac1a-bbc7-4e52-a077-6df0a2edd8e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:40.236220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38ac1a-bbc7-4e52-a077-6df0a2edd8e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:40.237580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38ac1a-bbc7-4e52-a077-6df0a2edd8e1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:40.243216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 499/1001] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Jun 24 10:20:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:40.248640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7200a6-7649-4265-9221-f8d21f1802ea None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:40.352444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7200a6-7649-4265-9221-f8d21f1802ea None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:40.369422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:40.388651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83e6f6-7013-4692-a40d-bd3d73d5f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:40.389323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83e6f6-7013-4692-a40d-bd3d73d5f064 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:40.389610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83e6f6-7013-4692-a40d-bd3d73d5f064 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:40.389889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83e6f6-7013-4692-a40d-bd3d73d5f064 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:40.390749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83e6f6-7013-4692-a40d-bd3d73d5f064 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:40.392157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83e6f6-7013-4692-a40d-bd3d73d5f064 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:40.407522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 503/1002] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Jun 24 10:20:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:20:40.815110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6c671-332d-4fad-867c-8c6ea7ce7183 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:40.815464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6c671-332d-4fad-867c-8c6ea7ce7183 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:40.815682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6c671-332d-4fad-867c-8c6ea7ce7183 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:40.817052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 500/1003] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:40.822989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366ae9-ffbc-4dff-8a52-0fd17498bae2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:40.823449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366ae9-ffbc-4dff-8a52-0fd17498bae2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:40.823551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366ae9-ffbc-4dff-8a52-0fd17498bae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:40.840927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5b366ae9-ffbc-4dff-8a52-0fd17498bae2 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:40.842150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5b366ae9-ffbc-4dff-8a52-0fd17498bae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:40.915410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 504/1004] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:40 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:40.938205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6c671-332d-4fad-867c-8c6ea7ce7183 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:41.045851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6c671-332d-4fad-867c-8c6ea7ce7183 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:41.059857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:41.082804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb091e-5774-42f5-ad48-f9a9b90789f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:41.083523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb091e-5774-42f5-ad48-f9a9b90789f2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:41.083813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb091e-5774-42f5-ad48-f9a9b90789f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:41.084094 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb091e-5774-42f5-ad48-f9a9b90789f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:41.084742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb091e-5774-42f5-ad48-f9a9b90789f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:41.086105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb091e-5774-42f5-ad48-f9a9b90789f2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-48cb091e-5774-42f5-ad48-f9a9b90789f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:41.097637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:41.099267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:20:41.100118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:41.102672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 501/1005] 10.222.0.44 () {56 vars in 1105 bytes} [Fri Jun 24 10:20:40 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:41.104689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b366ae9-ffbc-4dff-8a52-0fd17498bae2 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:41.208908 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b366ae9-ffbc-4dff-8a52-0fd17498bae2 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:41.211782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:41.246167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b95f1-fc2e-4bff-ae06-f0e5852a6411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:41.247136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b95f1-fc2e-4bff-ae06-f0e5852a6411 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:41.247562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b95f1-fc2e-4bff-ae06-f0e5852a6411 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:41.248002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b95f1-fc2e-4bff-ae06-f0e5852a6411 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:41.248837 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b95f1-fc2e-4bff-ae06-f0e5852a6411 None admin] RBAC: Adding query filter params (name=image) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:41.249283 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b95f1-fc2e-4bff-ae06-f0e5852a6411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:41.250803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b95f1-fc2e-4bff-ae06-f0e5852a6411 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:41.256078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 505/1006] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:41.261904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb091e-5774-42f5-ad48-f9a9b90789f2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:41.369644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb091e-5774-42f5-ad48-f9a9b90789f2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:41.403665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb21a56-c3d9-407b-b05e-f7c7bac270ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:41.404329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb21a56-c3d9-407b-b05e-f7c7bac270ba None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:41.404616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb21a56-c3d9-407b-b05e-f7c7bac270ba None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:41.404895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb21a56-c3d9-407b-b05e-f7c7bac270ba None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:41.405598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb21a56-c3d9-407b-b05e-f7c7bac270ba None admin] RBAC: Adding query filter params (type=image) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:41.405907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb21a56-c3d9-407b-b05e-f7c7bac270ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:41.407298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb21a56-c3d9-407b-b05e-f7c7bac270ba None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:41.418454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 502/1007] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:41.917972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4f70-366d-49e4-a679-2cfa37a9e9f8 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:41.918538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4f70-366d-49e4-a679-2cfa37a9e9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:41.918538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4f70-366d-49e4-a679-2cfa37a9e9f8 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:41.919954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 506/1008] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:41.925223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd2f7e-a1fe-433e-b39f-9d7777cc0c4e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:41.925515 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd2f7e-a1fe-433e-b39f-9d7777cc0c4e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:41.925794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd2f7e-a1fe-433e-b39f-9d7777cc0c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:41.942294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-88fd2f7e-a1fe-433e-b39f-9d7777cc0c4e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:41.943488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-88fd2f7e-a1fe-433e-b39f-9d7777cc0c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:41.978083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:42.018379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 503/1009] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:41 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:42.035148 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e4f70-366d-49e4-a679-2cfa37a9e9f8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:42.147846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e4f70-366d-49e4-a679-2cfa37a9e9f8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:42.183566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82beec-12eb-43c2-bcb1-33be5e1dc2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:42.184282 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82beec-12eb-43c2-bcb1-33be5e1dc2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:42.184563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82beec-12eb-43c2-bcb1-33be5e1dc2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:42.184840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82beec-12eb-43c2-bcb1-33be5e1dc2b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:42.185486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82beec-12eb-43c2-bcb1-33be5e1dc2b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:42.186878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82beec-12eb-43c2-bcb1-33be5e1dc2b3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-db82beec-12eb-43c2-bcb1-33be5e1dc2b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:42.199113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:42.200086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:42.200943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 507/1010] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:42.208113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd2f7e-a1fe-433e-b39f-9d7777cc0c4e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:42.313612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd2f7e-a1fe-433e-b39f-9d7777cc0c4e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:42.349306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26f474-ca39-4578-a65e-d45fdfacdd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:42.350008 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26f474-ca39-4578-a65e-d45fdfacdd7b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:42.350322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26f474-ca39-4578-a65e-d45fdfacdd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:42.350621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26f474-ca39-4578-a65e-d45fdfacdd7b None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:42.351315 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26f474-ca39-4578-a65e-d45fdfacdd7b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:42.351621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26f474-ca39-4578-a65e-d45fdfacdd7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:42.352975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26f474-ca39-4578-a65e-d45fdfacdd7b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:42.358238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 504/1011] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:42.363573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82beec-12eb-43c2-bcb1-33be5e1dc2b3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:42.402669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:42.479705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab5fc7-7226-45e0-8e49-812487491fbb None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:42.479899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab5fc7-7226-45e0-8e49-812487491fbb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:42.480181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab5fc7-7226-45e0-8e49-812487491fbb None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:42.481551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 505/1012] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:42.486800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c91b8-4e3a-4c79-a2e3-2ba370708cf7 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:42.487090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c91b8-4e3a-4c79-a2e3-2ba370708cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:42.487370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c91b8-4e3a-4c79-a2e3-2ba370708cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:42.489568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82beec-12eb-43c2-bcb1-33be5e1dc2b3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:42.507276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6f3c91b8-4e3a-4c79-a2e3-2ba370708cf7 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:42.508850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6f3c91b8-4e3a-4c79-a2e3-2ba370708cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:42.526566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795ca4b-8394-46ad-ae63-88ec062657a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:42.527241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795ca4b-8394-46ad-ae63-88ec062657a3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:42.527531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795ca4b-8394-46ad-ae63-88ec062657a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:42.527812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795ca4b-8394-46ad-ae63-88ec062657a3 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:42.528526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795ca4b-8394-46ad-ae63-88ec062657a3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:42.528833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795ca4b-8394-46ad-ae63-88ec062657a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:42.530204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795ca4b-8394-46ad-ae63-88ec062657a3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:42.540257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 508/1013] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Jun 24 10:20:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:42.541576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795ca4b-8394-46ad-ae63-88ec062657a3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:42.544388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:42.598425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 506/1014] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:42 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:42.617735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c91b8-4e3a-4c79-a2e3-2ba370708cf7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:42.651246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:42.659137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795ca4b-8394-46ad-ae63-88ec062657a3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:42.699267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28fd5b-4c66-4f01-af39-06a992137db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:42.699928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28fd5b-4c66-4f01-af39-06a992137db1 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:42.700216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28fd5b-4c66-4f01-af39-06a992137db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:42.700523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28fd5b-4c66-4f01-af39-06a992137db1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:42.701259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28fd5b-4c66-4f01-af39-06a992137db1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:42.702655 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28fd5b-4c66-4f01-af39-06a992137db1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:42.720829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c91b8-4e3a-4c79-a2e3-2ba370708cf7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:42.730463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 509/1015] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Jun 24 10:20:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:42.775484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a5910-27c2-4886-8916-3bb087148487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:42.776290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a5910-27c2-4886-8916-3bb087148487 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:42.776574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a5910-27c2-4886-8916-3bb087148487 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:42.776851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a5910-27c2-4886-8916-3bb087148487 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:42.778056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a5910-27c2-4886-8916-3bb087148487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:42.779541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a5910-27c2-4886-8916-3bb087148487 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:42.781249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 507/1016] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:42.787342 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28fd5b-4c66-4f01-af39-06a992137db1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:42.896699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28fd5b-4c66-4f01-af39-06a992137db1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:42.932185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58ed3f-3f17-4c5a-9f5b-159dc814a927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:42.932939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ed3f-3f17-4c5a-9f5b-159dc814a927 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:42.933112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ed3f-3f17-4c5a-9f5b-159dc814a927 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:42.933385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ed3f-3f17-4c5a-9f5b-159dc814a927 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:42.934103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58ed3f-3f17-4c5a-9f5b-159dc814a927 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:42.935560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58ed3f-3f17-4c5a-9f5b-159dc814a927 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:42.970515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 510/1017] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:20:42 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:43.453122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e4048-f827-4a93-acbd-527eca724fb6 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:43.453640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e4048-f827-4a93-acbd-527eca724fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:43.453746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e4048-f827-4a93-acbd-527eca724fb6 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:43.455250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 508/1018] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:43.460255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617341-d9c8-4c99-ba65-6fc870061857 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:43.460553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617341-d9c8-4c99-ba65-6fc870061857 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:43.460838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617341-d9c8-4c99-ba65-6fc870061857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:43.466916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:43.479662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-66617341-d9c8-4c99-ba65-6fc870061857 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:43.480854 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-66617341-d9c8-4c99-ba65-6fc870061857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:43.550391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 511/1019] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:43 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:43.573294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e4048-f827-4a93-acbd-527eca724fb6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:43.602804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:43.678002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e4048-f827-4a93-acbd-527eca724fb6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:43.711881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4b4a3-3a6a-4f1a-bdda-b181a05b12c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:43.712469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4b4a3-3a6a-4f1a-bdda-b181a05b12c0 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:43.712751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4b4a3-3a6a-4f1a-bdda-b181a05b12c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:43.713028 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4b4a3-3a6a-4f1a-bdda-b181a05b12c0 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:43.713743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4b4a3-3a6a-4f1a-bdda-b181a05b12c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:43.715130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4b4a3-3a6a-4f1a-bdda-b181a05b12c0 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:43.737974 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 509/1020] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:20:43 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:20:44.889754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f713f-fc80-4d70-bb31-bde834d33576 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:44.890773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f713f-fc80-4d70-bb31-bde834d33576 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:44.891072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f713f-fc80-4d70-bb31-bde834d33576 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:44.892491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 512/1021] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:44.897861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908443-ae9c-464b-a1b8-b340ae9ad1f4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:44.898294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908443-ae9c-464b-a1b8-b340ae9ad1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:44.898517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908443-ae9c-464b-a1b8-b340ae9ad1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:44.915458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-9a908443-ae9c-464b-a1b8-b340ae9ad1f4 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:44.916654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9a908443-ae9c-464b-a1b8-b340ae9ad1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:44.995007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 510/1022] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:45.018055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f713f-fc80-4d70-bb31-bde834d33576 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:45.038626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c8428-18cf-4c05-8f9e-778c8f8721fb None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.038951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c8428-18cf-4c05-8f9e-778c8f8721fb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.039193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c8428-18cf-4c05-8f9e-778c8f8721fb None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.040577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 511/1023] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:45.045403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c568bf-961b-4432-a4f8-f2a5b9c2139e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.045693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c568bf-961b-4432-a4f8-f2a5b9c2139e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.045973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c568bf-961b-4432-a4f8-f2a5b9c2139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.063553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-09c568bf-961b-4432-a4f8-f2a5b9c2139e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:45.064752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-09c568bf-961b-4432-a4f8-f2a5b9c2139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:45.074159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:45.126943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f713f-fc80-4d70-bb31-bde834d33576 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:45.140904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 512/1024] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:45.160713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504b501-625d-433b-9091-b94d8789cb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:45.161519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504b501-625d-433b-9091-b94d8789cb56 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.161800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504b501-625d-433b-9091-b94d8789cb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.162073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504b501-625d-433b-9091-b94d8789cb56 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.164617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:45.166523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c568bf-961b-4432-a4f8-f2a5b9c2139e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:45.175620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504b501-625d-433b-9091-b94d8789cb56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-1504b501-625d-433b-9091-b94d8789cb56 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:45.184243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:45.185293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:45.187861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 513/1025] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Jun 24 10:20:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:45.191175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504b501-625d-433b-9091-b94d8789cb56 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:45.282249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c568bf-961b-4432-a4f8-f2a5b9c2139e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:45.297620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504b501-625d-433b-9091-b94d8789cb56 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:45.323373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c002d90-8cb7-425a-9212-fdce9332677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:45.324550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002d90-8cb7-425a-9212-fdce9332677c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.325110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002d90-8cb7-425a-9212-fdce9332677c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.325393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002d90-8cb7-425a-9212-fdce9332677c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.326604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c002d90-8cb7-425a-9212-fdce9332677c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:45.328253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c002d90-8cb7-425a-9212-fdce9332677c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:45.330388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 513/1026] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:45.336103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c002d90-8cb7-425a-9212-fdce9332677c None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:45.337787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f7ac-1540-42c0-899c-334fb474ea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:45.337787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f7ac-1540-42c0-899c-334fb474ea42 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.338006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f7ac-1540-42c0-899c-334fb474ea42 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.338459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f7ac-1540-42c0-899c-334fb474ea42 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.339109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126f7ac-1540-42c0-899c-334fb474ea42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:45.339421 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126f7ac-1540-42c0-899c-334fb474ea42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:45.340800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126f7ac-1540-42c0-899c-334fb474ea42 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:45.354860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 514/1027] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Jun 24 10:20:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:45.355765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f7ac-1540-42c0-899c-334fb474ea42 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:45.356287 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:45.416087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:45.448246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c002d90-8cb7-425a-9212-fdce9332677c None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:45.460632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f7ac-1540-42c0-899c-334fb474ea42 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:45.486141 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8498eb-b8a4-45c3-af24-7381fb8ab622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:45.487064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8498eb-b8a4-45c3-af24-7381fb8ab622 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.487503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8498eb-b8a4-45c3-af24-7381fb8ab622 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.488034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8498eb-b8a4-45c3-af24-7381fb8ab622 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.489002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8498eb-b8a4-45c3-af24-7381fb8ab622 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:45.491138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8498eb-b8a4-45c3-af24-7381fb8ab622 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:45.493687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ca3c9-d2da-476b-833d-a13bb951bed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:45.494492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ca3c9-d2da-476b-833d-a13bb951bed9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.494788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ca3c9-d2da-476b-833d-a13bb951bed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.495059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ca3c9-d2da-476b-833d-a13bb951bed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.506286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ca3c9-d2da-476b-833d-a13bb951bed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:45.507897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ca3c9-d2da-476b-833d-a13bb951bed9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:45.518542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 514/1028] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:20:45 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-249ca3c9-d2da-476b-833d-a13bb951bed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:45.528202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:45.529225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:45.530263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:45.530263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:45.530263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:45.530263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:45.534406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 515/1029] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:45.535508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8498eb-b8a4-45c3-af24-7381fb8ab622 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:45.625383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:45.665800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8498eb-b8a4-45c3-af24-7381fb8ab622 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:45.701844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418e1b5-cb2b-4ca0-b0ba-f237b08a81a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:45.702463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e1b5-cb2b-4ca0-b0ba-f237b08a81a9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.702747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e1b5-cb2b-4ca0-b0ba-f237b08a81a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.703023 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418e1b5-cb2b-4ca0-b0ba-f237b08a81a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.703733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418e1b5-cb2b-4ca0-b0ba-f237b08a81a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:45.704034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418e1b5-cb2b-4ca0-b0ba-f237b08a81a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:45.705383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418e1b5-cb2b-4ca0-b0ba-f237b08a81a9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:45.719069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 515/1030] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:45.724192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ca3c9-d2da-476b-833d-a13bb951bed9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:45.774879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84994b-c725-4ca7-b63a-2c4712ae7154 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.775442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84994b-c725-4ca7-b63a-2c4712ae7154 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.775725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84994b-c725-4ca7-b63a-2c4712ae7154 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.777235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 516/1031] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:45.782282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c9028-27eb-45c1-a26c-2efb128db75e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.782752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c9028-27eb-45c1-a26c-2efb128db75e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.783173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c9028-27eb-45c1-a26c-2efb128db75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.800763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a09c9028-27eb-45c1-a26c-2efb128db75e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:45.802250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a09c9028-27eb-45c1-a26c-2efb128db75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:45.833572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ca3c9-d2da-476b-833d-a13bb951bed9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:45.844034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:45.872338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab9df6-a54f-4dbc-b03f-8d91d521b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:45.873137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab9df6-a54f-4dbc-b03f-8d91d521b532 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:45.873422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab9df6-a54f-4dbc-b03f-8d91d521b532 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:45.873694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab9df6-a54f-4dbc-b03f-8d91d521b532 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:45.874243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 517/1032] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:45.888936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab9df6-a54f-4dbc-b03f-8d91d521b532 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:45.888936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab9df6-a54f-4dbc-b03f-8d91d521b532 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:45.899161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c9028-27eb-45c1-a26c-2efb128db75e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-07ab9df6-a54f-4dbc-b03f-8d91d521b532 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:45.901185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:45.902506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:45.903466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:45.903466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:45.903466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:45.903466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:45.903466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:45.903466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:45.903466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:45.903466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:45.903466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:45.903466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:45.906668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 516/1033] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Jun 24 10:20:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:45.907981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab9df6-a54f-4dbc-b03f-8d91d521b532 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:45.962431 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:46.007938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c9028-27eb-45c1-a26c-2efb128db75e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:46.012040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab9df6-a54f-4dbc-b03f-8d91d521b532 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:46.045112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3649df-6ca2-465b-bcf8-af44620e574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:46.045459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c259ca2-9ec1-405d-8dc7-ac75f3dcfd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:46.046110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259ca2-9ec1-405d-8dc7-ac75f3dcfd2a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:46.046422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259ca2-9ec1-405d-8dc7-ac75f3dcfd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:46.046968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c259ca2-9ec1-405d-8dc7-ac75f3dcfd2a None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:46.047360 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3649df-6ca2-465b-bcf8-af44620e574b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:46.047810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c259ca2-9ec1-405d-8dc7-ac75f3dcfd2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:46.048039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3649df-6ca2-465b-bcf8-af44620e574b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:46.048137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c259ca2-9ec1-405d-8dc7-ac75f3dcfd2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:46.048607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3649df-6ca2-465b-bcf8-af44620e574b None admin] PATH_INFO: `/v3/services/image` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:46.049439 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3649df-6ca2-465b-bcf8-af44620e574b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:46.049541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c259ca2-9ec1-405d-8dc7-ac75f3dcfd2a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:46.051278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3649df-6ca2-465b-bcf8-af44620e574b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-ef3649df-6ca2-465b-bcf8-af44620e574b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:46.064649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:46.065743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:20:46.066603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:46.070511 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 518/1034] 10.222.0.44 () {56 vars in 1105 bytes} [Fri Jun 24 10:20:45 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:46.072227 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 517/1035] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Jun 24 10:20:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:46.072840 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3649df-6ca2-465b-bcf8-af44620e574b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:46.073104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c259ca2-9ec1-405d-8dc7-ac75f3dcfd2a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:46.100643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:46.177852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c259ca2-9ec1-405d-8dc7-ac75f3dcfd2a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:46.182446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3649df-6ca2-465b-bcf8-af44620e574b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:46.208773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:46.216604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd95ff-c2fb-4cb3-bf09-d7d4df406cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:46.217510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd95ff-c2fb-4cb3-bf09-d7d4df406cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:46.217950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd95ff-c2fb-4cb3-bf09-d7d4df406cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:46.218241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd95ff-c2fb-4cb3-bf09-d7d4df406cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:46.222255 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55461c-8a22-48be-b00e-49749ce1ea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:46.222961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55461c-8a22-48be-b00e-49749ce1ea29 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:46.223246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55461c-8a22-48be-b00e-49749ce1ea29 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:46.223523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55461c-8a22-48be-b00e-49749ce1ea29 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:46.224227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55461c-8a22-48be-b00e-49749ce1ea29 None admin] RBAC: Adding query filter params (name=image) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:46.224534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55461c-8a22-48be-b00e-49749ce1ea29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:46.225929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55461c-8a22-48be-b00e-49749ce1ea29 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:46.235345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 519/1036] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:46.236392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55461c-8a22-48be-b00e-49749ce1ea29 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:46.288921 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd95ff-c2fb-4cb3-bf09-d7d4df406cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:46.290742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd95ff-c2fb-4cb3-bf09-d7d4df406cd9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:46.318143 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:46.346257 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55461c-8a22-48be-b00e-49749ce1ea29 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:46.383189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b076f-f60f-4b60-83b6-45967b3107cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:46.383852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b076f-f60f-4b60-83b6-45967b3107cd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:46.384137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b076f-f60f-4b60-83b6-45967b3107cd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:46.384414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b076f-f60f-4b60-83b6-45967b3107cd None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:46.385122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b076f-f60f-4b60-83b6-45967b3107cd None admin] RBAC: Adding query filter params (type=image) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:46.385437 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b076f-f60f-4b60-83b6-45967b3107cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:46.387235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b076f-f60f-4b60-83b6-45967b3107cd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:46.392217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 520/1037] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:46.398000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b076f-f60f-4b60-83b6-45967b3107cd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:46.399091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 518/1038] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:20:46.404435 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd95ff-c2fb-4cb3-bf09-d7d4df406cd9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:46.454750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:46.507854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b076f-f60f-4b60-83b6-45967b3107cd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:46.508893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd95ff-c2fb-4cb3-bf09-d7d4df406cd9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:46.536517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:46.543995 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcf425-55ac-4fe8-9c2b-3feed27be82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:46.545305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcf425-55ac-4fe8-9c2b-3feed27be82e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:46.546161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcf425-55ac-4fe8-9c2b-3feed27be82e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:46.546941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4f100-0340-4347-8ea7-484dc8c3b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:46.547418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcf425-55ac-4fe8-9c2b-3feed27be82e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:46.547727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4f100-0340-4347-8ea7-484dc8c3b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:46.548015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4f100-0340-4347-8ea7-484dc8c3b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:46.548290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4f100-0340-4347-8ea7-484dc8c3b0e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:46.548837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcf425-55ac-4fe8-9c2b-3feed27be82e None admin] RBAC: Adding query filter params (interface=public, service_id=ada66c4a4e3e42869eca5888b0fce626, region_id=RegionOne) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:46.549300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcf425-55ac-4fe8-9c2b-3feed27be82e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:46.551682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcf425-55ac-4fe8-9c2b-3feed27be82e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:46.560215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4f100-0340-4347-8ea7-484dc8c3b0e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:46.560748 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 521/1039] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Jun 24 10:20:46 2022] GET /identity/v3/endpoints?service_id=ada66c4a4e3e42869eca5888b0fce626&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:46.562403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4f100-0340-4347-8ea7-484dc8c3b0e4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:46.567409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcf425-55ac-4fe8-9c2b-3feed27be82e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-f6d4f100-0340-4347-8ea7-484dc8c3b0e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:46.585729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:46.586719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:46.587633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:46.587633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:46.587633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:46.587633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:46.593444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 519/1040] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:46.594168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4f100-0340-4347-8ea7-484dc8c3b0e4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:46.680911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcf425-55ac-4fe8-9c2b-3feed27be82e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:46.694580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:46.702630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4f100-0340-4347-8ea7-484dc8c3b0e4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:46.717581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a325ff9-9f7d-46ce-951b-bb03b356a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:46.718251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a325ff9-9f7d-46ce-951b-bb03b356a89d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:46.718572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a325ff9-9f7d-46ce-951b-bb03b356a89d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:46.718853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a325ff9-9f7d-46ce-951b-bb03b356a89d None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:46.719535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a325ff9-9f7d-46ce-951b-bb03b356a89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:46.720906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a325ff9-9f7d-46ce-951b-bb03b356a89d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:46.728438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 522/1041] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Jun 24 10:20:46 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:20:46.752405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098873a-fcb2-43ed-8750-0915034267d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:46.753100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098873a-fcb2-43ed-8750-0915034267d1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:46.753387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098873a-fcb2-43ed-8750-0915034267d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:46.753665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098873a-fcb2-43ed-8750-0915034267d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:46.754452 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098873a-fcb2-43ed-8750-0915034267d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:46.754774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098873a-fcb2-43ed-8750-0915034267d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:46.756242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098873a-fcb2-43ed-8750-0915034267d1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:46.774104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 520/1042] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:46.775198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a325ff9-9f7d-46ce-951b-bb03b356a89d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:46.895928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a325ff9-9f7d-46ce-951b-bb03b356a89d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:46.931425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c14623-01f2-439a-afbb-cce372339ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:46.932221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c14623-01f2-439a-afbb-cce372339ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:46.932507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c14623-01f2-439a-afbb-cce372339ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:46.932784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c14623-01f2-439a-afbb-cce372339ea6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:46.939816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c14623-01f2-439a-afbb-cce372339ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:46.941253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c14623-01f2-439a-afbb-cce372339ea6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-59c14623-01f2-439a-afbb-cce372339ea6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:46.955830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:46.956709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:46.957615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:46.957615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:46.957615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:46.957615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:46.957615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:46.957615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:46.957615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:46.957615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:46.957615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 523/1043] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:46.963554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098873a-fcb2-43ed-8750-0915034267d1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:47.004980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:47.067800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098873a-fcb2-43ed-8750-0915034267d1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:47.102367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7f6ca-f14b-49cf-9ffe-d1f8ceac7a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:47.103044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7f6ca-f14b-49cf-9ffe-d1f8ceac7a74 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:47.103327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7f6ca-f14b-49cf-9ffe-d1f8ceac7a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:47.103607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7f6ca-f14b-49cf-9ffe-d1f8ceac7a74 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:47.104403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7f6ca-f14b-49cf-9ffe-d1f8ceac7a74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:47.104716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7f6ca-f14b-49cf-9ffe-d1f8ceac7a74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:47.106151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7f6ca-f14b-49cf-9ffe-d1f8ceac7a74 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:47.119040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 521/1044] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:47.124871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c14623-01f2-439a-afbb-cce372339ea6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:47.166822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:47.229964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c14623-01f2-439a-afbb-cce372339ea6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:47.264304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ae1d8-00fb-45ff-b30d-c935528aff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:47.264954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae1d8-00fb-45ff-b30d-c935528aff9c None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:47.265236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae1d8-00fb-45ff-b30d-c935528aff9c None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:47.265507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae1d8-00fb-45ff-b30d-c935528aff9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:47.266322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ae1d8-00fb-45ff-b30d-c935528aff9c None admin] RBAC: Adding query filter params (role.id=a36632e7ea7d4cbc904c35edc9e13bec, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=a66ff3915a784ddcb3925aadcb416700) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:47.266661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ae1d8-00fb-45ff-b30d-c935528aff9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:47.268078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ae1d8-00fb-45ff-b30d-c935528aff9c None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:47.273756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 524/1045] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:47 2022] GET /identity/v3/role_assignments?user.id=a66ff3915a784ddcb3925aadcb416700&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=a36632e7ea7d4cbc904c35edc9e13bec => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:47.641661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fc014-8514-42fc-abad-30c7fc575dda None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:47.641996 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fc014-8514-42fc-abad-30c7fc575dda None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:47.642382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fc014-8514-42fc-abad-30c7fc575dda None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:47.643809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 522/1046] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:47.649598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd196a8-fd43-49ac-8238-7ef157e3ac2a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:47.649887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd196a8-fd43-49ac-8238-7ef157e3ac2a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:47.650167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd196a8-fd43-49ac-8238-7ef157e3ac2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:47.668025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4cd196a8-fd43-49ac-8238-7ef157e3ac2a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:47.669208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4cd196a8-fd43-49ac-8238-7ef157e3ac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:47.736920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 525/1047] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:47.759915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fc014-8514-42fc-abad-30c7fc575dda None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:47.860848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:47.867222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fc014-8514-42fc-abad-30c7fc575dda None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:47.901973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bd247-537f-442e-b59f-912eea40990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:47.902801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bd247-537f-442e-b59f-912eea40990d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:47.903087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bd247-537f-442e-b59f-912eea40990d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:47.903362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bd247-537f-442e-b59f-912eea40990d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:47.914395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bd247-537f-442e-b59f-912eea40990d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-800bd247-537f-442e-b59f-912eea40990d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:47.922330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:47.923264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:47.924150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:47.926677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 523/1048] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:47.929613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd196a8-fd43-49ac-8238-7ef157e3ac2a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:47.961845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:48.033951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd196a8-fd43-49ac-8238-7ef157e3ac2a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:48.067601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759210e-e8d4-4e38-a732-1b5c67720830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:48.068261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759210e-e8d4-4e38-a732-1b5c67720830 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:48.069073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759210e-e8d4-4e38-a732-1b5c67720830 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:48.069357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759210e-e8d4-4e38-a732-1b5c67720830 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:48.070100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759210e-e8d4-4e38-a732-1b5c67720830 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:48.070435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759210e-e8d4-4e38-a732-1b5c67720830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:48.071798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759210e-e8d4-4e38-a732-1b5c67720830 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:48.079748 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 526/1049] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:48.086308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bd247-537f-442e-b59f-912eea40990d None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:48.187968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bd247-537f-442e-b59f-912eea40990d None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:48.222085 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d82bf3-6e7b-43d0-a6fa-9ab3453952ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:48.223073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d82bf3-6e7b-43d0-a6fa-9ab3453952ae None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:48.223363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d82bf3-6e7b-43d0-a6fa-9ab3453952ae None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:48.223642 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d82bf3-6e7b-43d0-a6fa-9ab3453952ae None admin] PATH_INFO: `/v3/users/c16c57532c7a4e01a0d739070bf30715` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:48.237098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d82bf3-6e7b-43d0-a6fa-9ab3453952ae None admin] RBAC: Authorizing `identity:get_user(user_id=c16c57532c7a4e01a0d739070bf30715)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:48.238659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d82bf3-6e7b-43d0-a6fa-9ab3453952ae None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:48.240496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 524/1050] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:20:48 2022] GET /identity/v3/users/c16c57532c7a4e01a0d739070bf30715 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:48.246106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759210e-e8d4-4e38-a732-1b5c67720830 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:48.346444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:48.354036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759210e-e8d4-4e38-a732-1b5c67720830 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:48.391010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4494c6-44f7-49d8-b67a-94224919be6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:48.391671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4494c6-44f7-49d8-b67a-94224919be6d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:48.391967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4494c6-44f7-49d8-b67a-94224919be6d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:48.392247 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4494c6-44f7-49d8-b67a-94224919be6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:48.462906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4494c6-44f7-49d8-b67a-94224919be6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:48.464336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4494c6-44f7-49d8-b67a-94224919be6d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:48.558111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:48.571284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 527/1051] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:48 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:20:48.572707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d82bf3-6e7b-43d0-a6fa-9ab3453952ae None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:48.591489 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:48.677143 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d82bf3-6e7b-43d0-a6fa-9ab3453952ae None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:48.711891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284fbc0-232e-4b52-b951-dfc9f99dff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:48.712750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284fbc0-232e-4b52-b951-dfc9f99dff79 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:48.713089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284fbc0-232e-4b52-b951-dfc9f99dff79 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:48.713318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284fbc0-232e-4b52-b951-dfc9f99dff79 None admin] PATH_INFO: `/v3/projects/2a2995d2f14444acb4244be37b1310b1` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:48.714534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284fbc0-232e-4b52-b951-dfc9f99dff79 None admin] RBAC: Authorizing `identity:get_project(project_id=2a2995d2f14444acb4244be37b1310b1)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:48.715979 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284fbc0-232e-4b52-b951-dfc9f99dff79 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:48.722741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 525/1052] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:20:48 2022] GET /identity/v3/projects/2a2995d2f14444acb4244be37b1310b1 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:48.723716 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4494c6-44f7-49d8-b67a-94224919be6d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:48.772787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569346d-b605-426f-83aa-919299ab8f54 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:48.773074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569346d-b605-426f-83aa-919299ab8f54 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:48.773355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569346d-b605-426f-83aa-919299ab8f54 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:48.774791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 526/1053] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:48.779930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab383141-ffc1-4ca6-a749-fca956de0189 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:48.780213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab383141-ffc1-4ca6-a749-fca956de0189 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:48.780490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab383141-ffc1-4ca6-a749-fca956de0189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:48.797897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ab383141-ffc1-4ca6-a749-fca956de0189 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:48.799098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ab383141-ffc1-4ca6-a749-fca956de0189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:48.836144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4494c6-44f7-49d8-b67a-94224919be6d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:48.870423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 527/1054] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:48.877340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd43a5-c799-469b-8dfc-72c6a3e3bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:48.878098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd43a5-c799-469b-8dfc-72c6a3e3bd7a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:48.878477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd43a5-c799-469b-8dfc-72c6a3e3bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:48.878825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd43a5-c799-469b-8dfc-72c6a3e3bd7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:48.879719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd43a5-c799-469b-8dfc-72c6a3e3bd7a None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=2a2995d2f14444acb4244be37b1310b1, user.id=c16c57532c7a4e01a0d739070bf30715) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:48.880102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd43a5-c799-469b-8dfc-72c6a3e3bd7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:48.881628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd43a5-c799-469b-8dfc-72c6a3e3bd7a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:48.894708 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 528/1055] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:48 2022] GET /identity/v3/role_assignments?user.id=c16c57532c7a4e01a0d739070bf30715&scope.project.id=2a2995d2f14444acb4244be37b1310b1&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:48.894911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab383141-ffc1-4ca6-a749-fca956de0189 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:48.908952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:49.004721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab383141-ffc1-4ca6-a749-fca956de0189 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:49.041809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197e4a-b963-4c39-9926-eedd0f803d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:49.042646 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197e4a-b963-4c39-9926-eedd0f803d4b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:49.042933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197e4a-b963-4c39-9926-eedd0f803d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:49.043210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197e4a-b963-4c39-9926-eedd0f803d4b None admin] PATH_INFO: `/v3/services/image` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:49.043875 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197e4a-b963-4c39-9926-eedd0f803d4b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:49.045250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197e4a-b963-4c39-9926-eedd0f803d4b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-77197e4a-b963-4c39-9926-eedd0f803d4b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:49.057934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:49.059066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 10:20:49.059926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:49.062421 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 528/1056] 10.222.0.44 () {56 vars in 1105 bytes} [Fri Jun 24 10:20:48 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:49.065408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd43a5-c799-469b-8dfc-72c6a3e3bd7a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:49.125960 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:49.170787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd43a5-c799-469b-8dfc-72c6a3e3bd7a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:49.205420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfcb45-7615-4def-bd39-fc3824328203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:49.206091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfcb45-7615-4def-bd39-fc3824328203 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:49.206398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfcb45-7615-4def-bd39-fc3824328203 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:49.206680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfcb45-7615-4def-bd39-fc3824328203 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:49.207381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfcb45-7615-4def-bd39-fc3824328203 None admin] RBAC: Adding query filter params (name=image) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:49.207690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfcb45-7615-4def-bd39-fc3824328203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:49.209044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfcb45-7615-4def-bd39-fc3824328203 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:49.214170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 529/1057] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:49.219718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197e4a-b963-4c39-9926-eedd0f803d4b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:49.281291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c574ae7-69f4-41f8-811d-e9fdf7306d03 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:49.281583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c574ae7-69f4-41f8-811d-e9fdf7306d03 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:49.281862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c574ae7-69f4-41f8-811d-e9fdf7306d03 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:49.283257 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 530/1058] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:49.288239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f863c67-cf5e-406d-b08e-42d6ab69e04c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:49.288526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f863c67-cf5e-406d-b08e-42d6ab69e04c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:49.288804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f863c67-cf5e-406d-b08e-42d6ab69e04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:49.306627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8f863c67-cf5e-406d-b08e-42d6ab69e04c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:49.306842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:49.307855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8f863c67-cf5e-406d-b08e-42d6ab69e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:49.332482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197e4a-b963-4c39-9926-eedd0f803d4b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:49.369324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1760c-5277-4d26-8e09-c08dedf749ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:49.370111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1760c-5277-4d26-8e09-c08dedf749ae None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:49.370416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1760c-5277-4d26-8e09-c08dedf749ae None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:49.370691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1760c-5277-4d26-8e09-c08dedf749ae None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:49.371399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1760c-5277-4d26-8e09-c08dedf749ae None admin] RBAC: Adding query filter params (type=image) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:49.371704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1760c-5277-4d26-8e09-c08dedf749ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:49.373361 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1760c-5277-4d26-8e09-c08dedf749ae None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:49.383946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 529/1059] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:49.385169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1760c-5277-4d26-8e09-c08dedf749ae None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:49.385918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 531/1060] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:49.408445 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f863c67-cf5e-406d-b08e-42d6ab69e04c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:49.465256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:49.495191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1760c-5277-4d26-8e09-c08dedf749ae None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:49.515786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f863c67-cf5e-406d-b08e-42d6ab69e04c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:49.532879 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a015d-a9cf-4cfd-a19e-7de91ea1ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:49.533468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a015d-a9cf-4cfd-a19e-7de91ea1ce99 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:49.533758 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a015d-a9cf-4cfd-a19e-7de91ea1ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:49.534250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a015d-a9cf-4cfd-a19e-7de91ea1ce99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:49.534804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a015d-a9cf-4cfd-a19e-7de91ea1ce99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:49.536172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a015d-a9cf-4cfd-a19e-7de91ea1ce99 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:49.551562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:49.554728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b658049-16ff-4f27-84db-8b7ad2487f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:49.555512 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b658049-16ff-4f27-84db-8b7ad2487f6a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:49.555794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b658049-16ff-4f27-84db-8b7ad2487f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:49.556092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b658049-16ff-4f27-84db-8b7ad2487f6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:49.561486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 530/1061] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Jun 24 10:20:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:20:49.578467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b658049-16ff-4f27-84db-8b7ad2487f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-1b658049-16ff-4f27-84db-8b7ad2487f6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:49.587173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:49.588202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:49.589044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:49.590315 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 532/1062] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Jun 24 10:20:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:49.595286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a015d-a9cf-4cfd-a19e-7de91ea1ce99 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:49.714269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a015d-a9cf-4cfd-a19e-7de91ea1ce99 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:49.751268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b7a8b-4855-48fa-820a-4f2270a8e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:49.751933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7a8b-4855-48fa-820a-4f2270a8e0db None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:49.752263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7a8b-4855-48fa-820a-4f2270a8e0db None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:49.752545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7a8b-4855-48fa-820a-4f2270a8e0db None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:49.753290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b7a8b-4855-48fa-820a-4f2270a8e0db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:49.753596 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b7a8b-4855-48fa-820a-4f2270a8e0db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:49.755023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b7a8b-4855-48fa-820a-4f2270a8e0db None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:49.764313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 531/1063] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Jun 24 10:20:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:49.770061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b658049-16ff-4f27-84db-8b7ad2487f6a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:49.869842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b658049-16ff-4f27-84db-8b7ad2487f6a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:49.882340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:49.905128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2d3f7-4882-4631-84f4-d5029d64aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:49.905915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2d3f7-4882-4631-84f4-d5029d64aed5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:49.906196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2d3f7-4882-4631-84f4-d5029d64aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:49.906503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2d3f7-4882-4631-84f4-d5029d64aed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:49.917583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2d3f7-4882-4631-84f4-d5029d64aed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:49.919053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2d3f7-4882-4631-84f4-d5029d64aed5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-48b2d3f7-4882-4631-84f4-d5029d64aed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:49.936123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:49.937220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:49.938157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:49.938157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:49.938157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:49.938157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:49.938157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 533/1064] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:49.943508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b7a8b-4855-48fa-820a-4f2270a8e0db None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:50.002834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:50.048562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b7a8b-4855-48fa-820a-4f2270a8e0db None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:50.084680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda8d30-7b55-404d-a3c1-04b46f75bac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:50.085346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda8d30-7b55-404d-a3c1-04b46f75bac4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:50.085632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda8d30-7b55-404d-a3c1-04b46f75bac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:50.085910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda8d30-7b55-404d-a3c1-04b46f75bac4 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:50.086660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda8d30-7b55-404d-a3c1-04b46f75bac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:50.086972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda8d30-7b55-404d-a3c1-04b46f75bac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:50.088350 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda8d30-7b55-404d-a3c1-04b46f75bac4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:50.100358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 532/1065] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:50.105874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2d3f7-4882-4631-84f4-d5029d64aed5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:50.205985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2d3f7-4882-4631-84f4-d5029d64aed5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:50.239939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadabc0a-48aa-4a79-9a20-9039c3866688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:50.240756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadabc0a-48aa-4a79-9a20-9039c3866688 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:50.241041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadabc0a-48aa-4a79-9a20-9039c3866688 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:50.241316 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadabc0a-48aa-4a79-9a20-9039c3866688 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:50.249026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadabc0a-48aa-4a79-9a20-9039c3866688 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:50.250482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadabc0a-48aa-4a79-9a20-9039c3866688 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-fadabc0a-48aa-4a79-9a20-9039c3866688 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:50.264582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:50.265530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:50.271288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 534/1066] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Jun 24 10:20:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:50.274254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda8d30-7b55-404d-a3c1-04b46f75bac4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:50.376439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda8d30-7b55-404d-a3c1-04b46f75bac4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:50.392850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:50.412204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37260376-5e43-471c-af02-f1ceb8286e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:50.412876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260376-5e43-471c-af02-f1ceb8286e86 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:50.413163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260376-5e43-471c-af02-f1ceb8286e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:50.413449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260376-5e43-471c-af02-f1ceb8286e86 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:50.414285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37260376-5e43-471c-af02-f1ceb8286e86 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:50.414629 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37260376-5e43-471c-af02-f1ceb8286e86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:50.416068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37260376-5e43-471c-af02-f1ceb8286e86 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:50.433667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 533/1067] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Jun 24 10:20:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:50.439284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadabc0a-48aa-4a79-9a20-9039c3866688 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:50.467100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:50.543839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadabc0a-48aa-4a79-9a20-9039c3866688 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:50.583431 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75581c8c-1edb-4b9b-948e-c67f09a24edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:50.584792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75581c8c-1edb-4b9b-948e-c67f09a24edf None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:50.585075 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75581c8c-1edb-4b9b-948e-c67f09a24edf None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:50.585352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75581c8c-1edb-4b9b-948e-c67f09a24edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:50.596444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75581c8c-1edb-4b9b-948e-c67f09a24edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:50.597884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75581c8c-1edb-4b9b-948e-c67f09a24edf None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-75581c8c-1edb-4b9b-948e-c67f09a24edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:50.616171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:50.617108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:50.618037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:50.618037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:50.618037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:50.618037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:50.621941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 535/1068] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:50.624183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37260376-5e43-471c-af02-f1ceb8286e86 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:50.727286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37260376-5e43-471c-af02-f1ceb8286e86 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:50.761881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030bee8-4ea6-474c-ae3f-35703e09d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:50.762771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bee8-4ea6-474c-ae3f-35703e09d687 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:50.763063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bee8-4ea6-474c-ae3f-35703e09d687 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:50.763342 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bee8-4ea6-474c-ae3f-35703e09d687 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:50.764065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030bee8-4ea6-474c-ae3f-35703e09d687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:50.764377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030bee8-4ea6-474c-ae3f-35703e09d687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:50.772417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030bee8-4ea6-474c-ae3f-35703e09d687 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:50.784616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 534/1069] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:50.790147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75581c8c-1edb-4b9b-948e-c67f09a24edf None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:50.870989 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:50.895099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21c62e-5ea4-4306-ab77-ef9a72432c2e None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:50.895392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21c62e-5ea4-4306-ab77-ef9a72432c2e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:50.895673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21c62e-5ea4-4306-ab77-ef9a72432c2e None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:50.895796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75581c8c-1edb-4b9b-948e-c67f09a24edf None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:50.897235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 535/1070] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:50.901950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c26c-100f-4b58-afc1-ad0a487452e7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:50.902244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c26c-100f-4b58-afc1-ad0a487452e7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:50.902559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c26c-100f-4b58-afc1-ad0a487452e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:50.919100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-90e8c26c-100f-4b58-afc1-ad0a487452e7 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:50.920281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-90e8c26c-100f-4b58-afc1-ad0a487452e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:50.931357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3575de-84e7-4355-b3d2-4bf24eb86272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:50.932444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3575de-84e7-4355-b3d2-4bf24eb86272 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:50.932728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3575de-84e7-4355-b3d2-4bf24eb86272 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:50.933140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3575de-84e7-4355-b3d2-4bf24eb86272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:50.939867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3575de-84e7-4355-b3d2-4bf24eb86272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:50.941291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3575de-84e7-4355-b3d2-4bf24eb86272 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:50.949443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-eb3575de-84e7-4355-b3d2-4bf24eb86272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:50.955911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:50.956821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:50.962944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:50.962944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:50.962944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:50.962944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:50.962944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:50.962944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:50.962944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:50.962944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:50.962944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 536/1071] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:50.963726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3575de-84e7-4355-b3d2-4bf24eb86272 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:50.999170 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 536/1072] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:51.021042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c26c-100f-4b58-afc1-ad0a487452e7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:51.064475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3575de-84e7-4355-b3d2-4bf24eb86272 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:51.100890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aedc6f-0672-473b-8801-f5d3e434788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:51.101814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aedc6f-0672-473b-8801-f5d3e434788a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:51.102100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aedc6f-0672-473b-8801-f5d3e434788a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:51.102405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aedc6f-0672-473b-8801-f5d3e434788a None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:51.103191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aedc6f-0672-473b-8801-f5d3e434788a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:51.103502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aedc6f-0672-473b-8801-f5d3e434788a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:51.104927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aedc6f-0672-473b-8801-f5d3e434788a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:51.107510 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:51.122163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 537/1073] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:51.123985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aedc6f-0672-473b-8801-f5d3e434788a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:51.129681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c26c-100f-4b58-afc1-ad0a487452e7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:51.166725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83278-0fa9-4ef1-bb95-bdbfe30ecd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:51.167621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83278-0fa9-4ef1-bb95-bdbfe30ecd7f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:51.167926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83278-0fa9-4ef1-bb95-bdbfe30ecd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:51.168208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83278-0fa9-4ef1-bb95-bdbfe30ecd7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:51.180362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e83278-0fa9-4ef1-bb95-bdbfe30ecd7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-f1e83278-0fa9-4ef1-bb95-bdbfe30ecd7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:51.188688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:51.189635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:51.190526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 537/1074] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:51.195811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83278-0fa9-4ef1-bb95-bdbfe30ecd7f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:51.222866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:51.234036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aedc6f-0672-473b-8801-f5d3e434788a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:51.268125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee15775-e93e-4cfa-a380-e67a3b9bd40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:51.268944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee15775-e93e-4cfa-a380-e67a3b9bd40e None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:51.269219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee15775-e93e-4cfa-a380-e67a3b9bd40e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:51.269500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee15775-e93e-4cfa-a380-e67a3b9bd40e None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/a66ff3915a784ddcb3925aadcb416700/roles/a36632e7ea7d4cbc904c35edc9e13bec` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:51.272841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee15775-e93e-4cfa-a380-e67a3b9bd40e None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=a66ff3915a784ddcb3925aadcb416700, role_id=a36632e7ea7d4cbc904c35edc9e13bec)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:51.274270 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee15775-e93e-4cfa-a380-e67a3b9bd40e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:51.290103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 538/1075] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:20:51 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/a66ff3915a784ddcb3925aadcb416700/roles/a36632e7ea7d4cbc904c35edc9e13bec => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:20:51.310560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83278-0fa9-4ef1-bb95-bdbfe30ecd7f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:51.350399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de5c8e-c387-44bd-acf6-891ab5fc7b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:51.351340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5c8e-c387-44bd-acf6-891ab5fc7b9b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:51.351824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5c8e-c387-44bd-acf6-891ab5fc7b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:51.352251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5c8e-c387-44bd-acf6-891ab5fc7b9b None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:51.353161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de5c8e-c387-44bd-acf6-891ab5fc7b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:51.353633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de5c8e-c387-44bd-acf6-891ab5fc7b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:51.355238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de5c8e-c387-44bd-acf6-891ab5fc7b9b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:51.365297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 538/1076] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:51.371803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee15775-e93e-4cfa-a380-e67a3b9bd40e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:51.438289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:51.490994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee15775-e93e-4cfa-a380-e67a3b9bd40e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:51.525777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a0ca3-f3f2-48e5-847e-bd64feebccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:51.526605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0ca3-f3f2-48e5-847e-bd64feebccea None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:51.526894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0ca3-f3f2-48e5-847e-bd64feebccea None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:51.527170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0ca3-f3f2-48e5-847e-bd64feebccea None admin] PATH_INFO: `/v3/users/c16c57532c7a4e01a0d739070bf30715` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:51.528363 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a0ca3-f3f2-48e5-847e-bd64feebccea None admin] RBAC: Authorizing `identity:get_user(user_id=c16c57532c7a4e01a0d739070bf30715)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:51.529794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a0ca3-f3f2-48e5-847e-bd64feebccea None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:51.535971 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 539/1077] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:20:51 2022] GET /identity/v3/users/c16c57532c7a4e01a0d739070bf30715 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:51.538117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de5c8e-c387-44bd-acf6-891ab5fc7b9b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:51.631260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1d15-44ac-4a2f-ac57-d95a232a3056 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:51.631589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1d15-44ac-4a2f-ac57-d95a232a3056 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:51.631816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1d15-44ac-4a2f-ac57-d95a232a3056 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:51.633187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 540/1078] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:20:51.633800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:51.638124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5987-61ae-4f22-b34b-78610b310ebe None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:51.638481 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5987-61ae-4f22-b34b-78610b310ebe None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:51.638767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5987-61ae-4f22-b34b-78610b310ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:51.652338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de5c8e-c387-44bd-acf6-891ab5fc7b9b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:51.656280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8ffa5987-61ae-4f22-b34b-78610b310ebe None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:51.657469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8ffa5987-61ae-4f22-b34b-78610b310ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:51.690187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349a9cf-7d4a-40dd-b20e-f5716d4ea0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:51.691084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349a9cf-7d4a-40dd-b20e-f5716d4ea0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:51.691373 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349a9cf-7d4a-40dd-b20e-f5716d4ea0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:51.691654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349a9cf-7d4a-40dd-b20e-f5716d4ea0d7 None admin] PATH_INFO: `/v3/projects/2a2995d2f14444acb4244be37b1310b1` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:51.692850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349a9cf-7d4a-40dd-b20e-f5716d4ea0d7 None admin] RBAC: Authorizing `identity:get_project(project_id=2a2995d2f14444acb4244be37b1310b1)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:51.694322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349a9cf-7d4a-40dd-b20e-f5716d4ea0d7 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:51.696218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 539/1079] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:20:51 2022] GET /identity/v3/projects/2a2995d2f14444acb4244be37b1310b1 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:51.701876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349a9cf-7d4a-40dd-b20e-f5716d4ea0d7 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:51.737112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 541/1080] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:51.756505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5987-61ae-4f22-b34b-78610b310ebe None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:51.818915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:51.823949 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349a9cf-7d4a-40dd-b20e-f5716d4ea0d7 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:51.859432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34846b4d-b06f-442d-8893-93d9881d4f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:51.860308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34846b4d-b06f-442d-8893-93d9881d4f47 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:51.860588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34846b4d-b06f-442d-8893-93d9881d4f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:51.860864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34846b4d-b06f-442d-8893-93d9881d4f47 None admin] PATH_INFO: `/v3/projects/2a2995d2f14444acb4244be37b1310b1/users/c16c57532c7a4e01a0d739070bf30715/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:51.862843 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34846b4d-b06f-442d-8893-93d9881d4f47 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a2995d2f14444acb4244be37b1310b1, user_id=c16c57532c7a4e01a0d739070bf30715, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:51.864272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34846b4d-b06f-442d-8893-93d9881d4f47 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:51.865145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5987-61ae-4f22-b34b-78610b310ebe None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:51.878433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 540/1081] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:20:51 2022] PUT /identity/v3/projects/2a2995d2f14444acb4244be37b1310b1/users/c16c57532c7a4e01a0d739070bf30715/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:20:51.902993 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947879ba-a580-4d56-8a9b-ef855e73ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:51.903671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947879ba-a580-4d56-8a9b-ef855e73ed3d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:51.903957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947879ba-a580-4d56-8a9b-ef855e73ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:51.904235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947879ba-a580-4d56-8a9b-ef855e73ed3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:51.980147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947879ba-a580-4d56-8a9b-ef855e73ed3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:51.981617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947879ba-a580-4d56-8a9b-ef855e73ed3d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:52.043412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:52.091477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 542/1082] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 10:20:52.097713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34846b4d-b06f-442d-8893-93d9881d4f47 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:52.114563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:52.204337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34846b4d-b06f-442d-8893-93d9881d4f47 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:52.237746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd568-82b3-42bb-8790-dcb2b87ab038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:52.238571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd568-82b3-42bb-8790-dcb2b87ab038 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:52.238867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd568-82b3-42bb-8790-dcb2b87ab038 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:52.239146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd568-82b3-42bb-8790-dcb2b87ab038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:52.250296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdd568-82b3-42bb-8790-dcb2b87ab038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:52.251785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdd568-82b3-42bb-8790-dcb2b87ab038 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-80fdd568-82b3-42bb-8790-dcb2b87ab038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:52.268958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:52.269867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:52.271320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:52.271320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:52.271320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:52.271320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:52.274429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 541/1083] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:52.276145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947879ba-a580-4d56-8a9b-ef855e73ed3d None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:52.379564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947879ba-a580-4d56-8a9b-ef855e73ed3d None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:52.415468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dbdfa-c64b-412c-8da4-13392d4bdb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:52.416133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbdfa-c64b-412c-8da4-13392d4bdb83 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:52.416418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbdfa-c64b-412c-8da4-13392d4bdb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:52.416696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbdfa-c64b-412c-8da4-13392d4bdb83 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:52.417422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dbdfa-c64b-412c-8da4-13392d4bdb83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:52.417735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dbdfa-c64b-412c-8da4-13392d4bdb83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:52.419125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dbdfa-c64b-412c-8da4-13392d4bdb83 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:52.438386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 543/1084] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:53.351952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbbf29-3c7c-4700-aa88-3983d06852b1 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:53.352542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbbf29-3c7c-4700-aa88-3983d06852b1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:53.352542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbbf29-3c7c-4700-aa88-3983d06852b1 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:53.353891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 542/1085] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:53.358965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e068eb-d468-473c-b65e-527249ae7ccf None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:53.359400 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e068eb-d468-473c-b65e-527249ae7ccf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:53.359527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e068eb-d468-473c-b65e-527249ae7ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:53.376492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-96e068eb-d468-473c-b65e-527249ae7ccf None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:53.377671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-96e068eb-d468-473c-b65e-527249ae7ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:53.387191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:53.445762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 544/1086] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:53.469171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbbf29-3c7c-4700-aa88-3983d06852b1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:53.533658 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:53.573381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbbf29-3c7c-4700-aa88-3983d06852b1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:53.606915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591142db-c624-4365-bdd5-c1f431c3c744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:53.607637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591142db-c624-4365-bdd5-c1f431c3c744 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:53.607919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591142db-c624-4365-bdd5-c1f431c3c744 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:53.608193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591142db-c624-4365-bdd5-c1f431c3c744 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:53.618621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591142db-c624-4365-bdd5-c1f431c3c744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-591142db-c624-4365-bdd5-c1f431c3c744 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:53.626471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:53.627627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:53.628538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 543/1087] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Jun 24 10:20:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:53.633745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e068eb-d468-473c-b65e-527249ae7ccf None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:53.730689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e068eb-d468-473c-b65e-527249ae7ccf None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:53.762931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020bd40-fb5b-4c57-b43d-2733b68f98b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:53.763595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020bd40-fb5b-4c57-b43d-2733b68f98b9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:53.763880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020bd40-fb5b-4c57-b43d-2733b68f98b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:53.764154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020bd40-fb5b-4c57-b43d-2733b68f98b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:53.764902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020bd40-fb5b-4c57-b43d-2733b68f98b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:53.765209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020bd40-fb5b-4c57-b43d-2733b68f98b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:53.766594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020bd40-fb5b-4c57-b43d-2733b68f98b9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:53.775229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 545/1088] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Jun 24 10:20:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:53.780611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591142db-c624-4365-bdd5-c1f431c3c744 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:53.879073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591142db-c624-4365-bdd5-c1f431c3c744 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:53.904180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:53.914005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf3385-07c5-4b09-8d14-e4cb5d3fa659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:53.914907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3385-07c5-4b09-8d14-e4cb5d3fa659 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:53.915195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3385-07c5-4b09-8d14-e4cb5d3fa659 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:53.915469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3385-07c5-4b09-8d14-e4cb5d3fa659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:53.916363 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64b84-c1ae-44d7-bb9f-68cb9ee63a8b None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:53.916661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64b84-c1ae-44d7-bb9f-68cb9ee63a8b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:53.916944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64b84-c1ae-44d7-bb9f-68cb9ee63a8b None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:53.918324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 546/1089] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:53.923749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1984c9-f6da-4c18-852f-2173519b0d41 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:53.924038 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1984c9-f6da-4c18-852f-2173519b0d41 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:53.924323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1984c9-f6da-4c18-852f-2173519b0d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:53.926295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf3385-07c5-4b09-8d14-e4cb5d3fa659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:53.927799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf3385-07c5-4b09-8d14-e4cb5d3fa659 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:53.936504 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:53.942287 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ad1984c9-f6da-4c18-852f-2173519b0d41 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:53.943558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ad1984c9-f6da-4c18-852f-2173519b0d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2aaf3385-07c5-4b09-8d14-e4cb5d3fa659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:53.945195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:53.946100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:53.947063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:53.947063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:53.947063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:53.947063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:53.947063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 544/1090] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:20:53.952066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf3385-07c5-4b09-8d14-e4cb5d3fa659 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.012588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 547/1091] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:54.036349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1984c9-f6da-4c18-852f-2173519b0d41 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.049202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf3385-07c5-4b09-8d14-e4cb5d3fa659 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:54.085035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f820ba-a0c1-418b-b0dc-9dd3a38f0448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:54.085685 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f820ba-a0c1-418b-b0dc-9dd3a38f0448 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:54.085972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f820ba-a0c1-418b-b0dc-9dd3a38f0448 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:54.086248 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f820ba-a0c1-418b-b0dc-9dd3a38f0448 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:54.086991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f820ba-a0c1-418b-b0dc-9dd3a38f0448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:54.087297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f820ba-a0c1-418b-b0dc-9dd3a38f0448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:54.088657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f820ba-a0c1-418b-b0dc-9dd3a38f0448 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:54.099585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 545/1092] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:54.105049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f820ba-a0c1-418b-b0dc-9dd3a38f0448 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.132834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1984c9-f6da-4c18-852f-2173519b0d41 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:54.144087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:54.169825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028048-71e1-468a-ac37-4aef3aa1311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:54.170634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028048-71e1-468a-ac37-4aef3aa1311a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:54.170926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028048-71e1-468a-ac37-4aef3aa1311a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:54.171201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028048-71e1-468a-ac37-4aef3aa1311a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:54.174127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:54.183399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86028048-71e1-468a-ac37-4aef3aa1311a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-86028048-71e1-468a-ac37-4aef3aa1311a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:20:54.190847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:54.191781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:20:54.192626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 548/1093] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:54.198196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028048-71e1-468a-ac37-4aef3aa1311a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.205382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f820ba-a0c1-418b-b0dc-9dd3a38f0448 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:54.238212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aabbf-bafa-4e6e-9e8f-2598de21e904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:54.239026 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aabbf-bafa-4e6e-9e8f-2598de21e904 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:54.239310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aabbf-bafa-4e6e-9e8f-2598de21e904 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:54.239575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aabbf-bafa-4e6e-9e8f-2598de21e904 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:54.247479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5aabbf-bafa-4e6e-9e8f-2598de21e904 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:54.248911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5aabbf-bafa-4e6e-9e8f-2598de21e904 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-6e5aabbf-bafa-4e6e-9e8f-2598de21e904 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:20:54.262516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:54.263568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:54.264527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 546/1094] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:54.269216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aabbf-bafa-4e6e-9e8f-2598de21e904 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.300273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028048-71e1-468a-ac37-4aef3aa1311a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:54.334249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3d73e-e2cc-48a7-8116-baf4c628d413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:54.334938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3d73e-e2cc-48a7-8116-baf4c628d413 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:54.335218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3d73e-e2cc-48a7-8116-baf4c628d413 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:54.335495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3d73e-e2cc-48a7-8116-baf4c628d413 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:54.336248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3d73e-e2cc-48a7-8116-baf4c628d413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:54.336541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3d73e-e2cc-48a7-8116-baf4c628d413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:54.337890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3d73e-e2cc-48a7-8116-baf4c628d413 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:54.345720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 549/1095] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:54.351901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3d73e-e2cc-48a7-8116-baf4c628d413 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.364638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:54.368553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aabbf-bafa-4e6e-9e8f-2598de21e904 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:54.402339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a6b0f-9e10-4195-bf59-0c0d4019adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:54.403097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a6b0f-9e10-4195-bf59-0c0d4019adfe None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:54.403389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a6b0f-9e10-4195-bf59-0c0d4019adfe None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:54.403669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a6b0f-9e10-4195-bf59-0c0d4019adfe None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:54.404502 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a6b0f-9e10-4195-bf59-0c0d4019adfe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:54.404813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a6b0f-9e10-4195-bf59-0c0d4019adfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:54.406240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a6b0f-9e10-4195-bf59-0c0d4019adfe None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:54.409386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:54.423947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 547/1096] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:54.429549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a6b0f-9e10-4195-bf59-0c0d4019adfe None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.453536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3d73e-e2cc-48a7-8116-baf4c628d413 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:54.487493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80c2fe-da5a-4ae6-a0af-8ae35d1608f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:54.488352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c2fe-da5a-4ae6-a0af-8ae35d1608f6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:54.488630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c2fe-da5a-4ae6-a0af-8ae35d1608f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:54.488899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c2fe-da5a-4ae6-a0af-8ae35d1608f6 None admin] PATH_INFO: `/v3/users/c16c57532c7a4e01a0d739070bf30715` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:54.490108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80c2fe-da5a-4ae6-a0af-8ae35d1608f6 None admin] RBAC: Authorizing `identity:get_user(user_id=c16c57532c7a4e01a0d739070bf30715)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:54.491549 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80c2fe-da5a-4ae6-a0af-8ae35d1608f6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:54.493148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 550/1097] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/users/c16c57532c7a4e01a0d739070bf30715 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:54.498652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80c2fe-da5a-4ae6-a0af-8ae35d1608f6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.526883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a6b0f-9e10-4195-bf59-0c0d4019adfe None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:54.561054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d5fd-917e-41af-bb04-f9d44fbcd963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:54.561710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d5fd-917e-41af-bb04-f9d44fbcd963 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:54.561993 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d5fd-917e-41af-bb04-f9d44fbcd963 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:54.562267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d5fd-917e-41af-bb04-f9d44fbcd963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:54.587144 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:54.596613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80c2fe-da5a-4ae6-a0af-8ae35d1608f6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:54.621391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:54.630446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b72b4-3b8f-45f3-9dfc-92247bdd02c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:54.630941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d5fd-917e-41af-bb04-f9d44fbcd963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:54.631131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b72b4-3b8f-45f3-9dfc-92247bdd02c2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:54.631412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b72b4-3b8f-45f3-9dfc-92247bdd02c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:54.631687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b72b4-3b8f-45f3-9dfc-92247bdd02c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:54.632393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d5fd-917e-41af-bb04-f9d44fbcd963 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:54.700168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b72b4-3b8f-45f3-9dfc-92247bdd02c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:54.701525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b72b4-3b8f-45f3-9dfc-92247bdd02c2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:54.731756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 548/1098] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 10:20:54.737236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d5fd-917e-41af-bb04-f9d44fbcd963 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.790927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:54.801048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 551/1099] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 10:20:54.806753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b72b4-3b8f-45f3-9dfc-92247bdd02c2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.832411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:54.840735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d5fd-917e-41af-bb04-f9d44fbcd963 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:54.873518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f3aa3-5e69-4060-a12c-2f2dc4544a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:54.874293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f3aa3-5e69-4060-a12c-2f2dc4544a39 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:54.874611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f3aa3-5e69-4060-a12c-2f2dc4544a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:54.874882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f3aa3-5e69-4060-a12c-2f2dc4544a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:54.885034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f3aa3-5e69-4060-a12c-2f2dc4544a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:54.886493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f3aa3-5e69-4060-a12c-2f2dc4544a39 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:54.903465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b72b4-3b8f-45f3-9dfc-92247bdd02c2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ae9f3aa3-5e69-4060-a12c-2f2dc4544a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:20:54.904154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:54.905216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:54.906391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:20:54.906391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:20:54.906391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:20:54.906391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:54.906391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 549/1100] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:54.910890 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f3aa3-5e69-4060-a12c-2f2dc4544a39 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:54.939103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a8eb-7e9d-4575-ad89-4bffb8d3bc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:54.939985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a8eb-7e9d-4575-ad89-4bffb8d3bc97 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:54.940274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a8eb-7e9d-4575-ad89-4bffb8d3bc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:54.940553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a8eb-7e9d-4575-ad89-4bffb8d3bc97 None admin] PATH_INFO: `/v3/projects/2a2995d2f14444acb4244be37b1310b1` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:54.941730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a8eb-7e9d-4575-ad89-4bffb8d3bc97 None admin] RBAC: Authorizing `identity:get_project(project_id=2a2995d2f14444acb4244be37b1310b1)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:54.943724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a8eb-7e9d-4575-ad89-4bffb8d3bc97 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:54.945428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 552/1101] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/projects/2a2995d2f14444acb4244be37b1310b1 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:54.951226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a8eb-7e9d-4575-ad89-4bffb8d3bc97 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:55.008336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f3aa3-5e69-4060-a12c-2f2dc4544a39 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:55.017651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:55.042672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:55.043948 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae4cea-0f3d-4823-b63c-6398e24dae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:55.044667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4cea-0f3d-4823-b63c-6398e24dae0f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:55.044991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4cea-0f3d-4823-b63c-6398e24dae0f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:55.045298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4cea-0f3d-4823-b63c-6398e24dae0f None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:55.046000 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae4cea-0f3d-4823-b63c-6398e24dae0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:55.046631 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae4cea-0f3d-4823-b63c-6398e24dae0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:55.047926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae4cea-0f3d-4823-b63c-6398e24dae0f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:55.050267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a8eb-7e9d-4575-ad89-4bffb8d3bc97 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:55.058834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 550/1102] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:55.064271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae4cea-0f3d-4823-b63c-6398e24dae0f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:55.087484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e0445-15b1-4f4e-9116-c6c43053c593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:55.088133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e0445-15b1-4f4e-9116-c6c43053c593 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:55.088420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e0445-15b1-4f4e-9116-c6c43053c593 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:55.088700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e0445-15b1-4f4e-9116-c6c43053c593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:55.089521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e0445-15b1-4f4e-9116-c6c43053c593 None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=2a2995d2f14444acb4244be37b1310b1, user.id=c16c57532c7a4e01a0d739070bf30715) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:55.089831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e0445-15b1-4f4e-9116-c6c43053c593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:55.091269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e0445-15b1-4f4e-9116-c6c43053c593 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:55.097026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 553/1103] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:54 2022] GET /identity/v3/role_assignments?user.id=c16c57532c7a4e01a0d739070bf30715&scope.project.id=2a2995d2f14444acb4244be37b1310b1&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:20:55.168005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae4cea-0f3d-4823-b63c-6398e24dae0f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:55.203953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fb1b2-2812-41ae-9175-ff8de66ad9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:55.204682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fb1b2-2812-41ae-9175-ff8de66ad9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:55.204969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fb1b2-2812-41ae-9175-ff8de66ad9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:55.205247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fb1b2-2812-41ae-9175-ff8de66ad9e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:55.212840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fb1b2-2812-41ae-9175-ff8de66ad9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:55.214313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fb1b2-2812-41ae-9175-ff8de66ad9e9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-d95fb1b2-2812-41ae-9175-ff8de66ad9e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:20:55.229104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:20:55.230098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:20:55.231107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:20:55.231107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:20:55.231107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:20:55.231107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:20:55.231107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:20:55.231107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:20:55.231107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:20:55.231107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:20:55.231107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 551/1104] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:20:55.236446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e0445-15b1-4f4e-9116-c6c43053c593 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:55.344979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e0445-15b1-4f4e-9116-c6c43053c593 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:55.379037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3e281-b309-4433-9e28-2c04cb501bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:55.379673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e281-b309-4433-9e28-2c04cb501bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:55.379955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e281-b309-4433-9e28-2c04cb501bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:55.380225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e281-b309-4433-9e28-2c04cb501bf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:55.381548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3e281-b309-4433-9e28-2c04cb501bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:55.381852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3e281-b309-4433-9e28-2c04cb501bf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:55.383300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3e281-b309-4433-9e28-2c04cb501bf5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:55.394629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 554/1105] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:55.400745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fb1b2-2812-41ae-9175-ff8de66ad9e9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:55.429507 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:55.514058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fb1b2-2812-41ae-9175-ff8de66ad9e9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:55.547623 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9716b5a-c19e-4b7f-a3cf-86222fba447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:55.548273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716b5a-c19e-4b7f-a3cf-86222fba447b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:55.548559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716b5a-c19e-4b7f-a3cf-86222fba447b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:55.548834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716b5a-c19e-4b7f-a3cf-86222fba447b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:55.549658 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9716b5a-c19e-4b7f-a3cf-86222fba447b None admin] RBAC: Adding query filter params (role.id=a36632e7ea7d4cbc904c35edc9e13bec, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=a66ff3915a784ddcb3925aadcb416700) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:20:55.549970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9716b5a-c19e-4b7f-a3cf-86222fba447b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:55.551436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9716b5a-c19e-4b7f-a3cf-86222fba447b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:55.558320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 552/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:20:55 2022] GET /identity/v3/role_assignments?user.id=a66ff3915a784ddcb3925aadcb416700&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=a36632e7ea7d4cbc904c35edc9e13bec => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:57.165662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155107f6-591f-4f04-ae66-18e0723436ea None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:57.166204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155107f6-591f-4f04-ae66-18e0723436ea None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:57.166204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155107f6-591f-4f04-ae66-18e0723436ea None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:57.167602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 555/1107] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:57.172918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ec624-8242-48f1-80db-b51f35dc7ae4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:57.173340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ec624-8242-48f1-80db-b51f35dc7ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:57.173477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ec624-8242-48f1-80db-b51f35dc7ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:57.190250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-364ec624-8242-48f1-80db-b51f35dc7ae4 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:57.191466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-364ec624-8242-48f1-80db-b51f35dc7ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:57.257293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 553/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:57.281674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155107f6-591f-4f04-ae66-18e0723436ea None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:57.302189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:57.383887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155107f6-591f-4f04-ae66-18e0723436ea None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:57.417613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c372d2-f2d0-468a-a3b0-3918eb9a9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:57.418329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c372d2-f2d0-468a-a3b0-3918eb9a9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:57.418645 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c372d2-f2d0-468a-a3b0-3918eb9a9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:57.418922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c372d2-f2d0-468a-a3b0-3918eb9a9ee9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:57.420085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c372d2-f2d0-468a-a3b0-3918eb9a9ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:57.421768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c372d2-f2d0-468a-a3b0-3918eb9a9ee9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:57.423421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 556/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:20:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:57.429191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ec624-8242-48f1-80db-b51f35dc7ae4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:57.451987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:57.529091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ec624-8242-48f1-80db-b51f35dc7ae4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:57.561438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980e6e7-f68f-43dd-a667-27f30df0bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:57.562104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980e6e7-f68f-43dd-a667-27f30df0bfc5 None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:57.562412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980e6e7-f68f-43dd-a667-27f30df0bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:57.562690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980e6e7-f68f-43dd-a667-27f30df0bfc5 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:57.563389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980e6e7-f68f-43dd-a667-27f30df0bfc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:57.564810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980e6e7-f68f-43dd-a667-27f30df0bfc5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:57.584733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 554/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:20:57 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:20:59.627358 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3e13e-a524-4b82-9d9c-c12be635cd6a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:59.627872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3e13e-a524-4b82-9d9c-c12be635cd6a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:59.627966 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3e13e-a524-4b82-9d9c-c12be635cd6a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:59.629282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 557/1111] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:20:59.634579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5012d1-a598-4170-b8ee-6a76b656043a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:59.634996 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5012d1-a598-4170-b8ee-6a76b656043a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:59.635140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5012d1-a598-4170-b8ee-6a76b656043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:59.652141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-da5012d1-a598-4170-b8ee-6a76b656043a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:20:59.653334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-da5012d1-a598-4170-b8ee-6a76b656043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:20:59.718184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 555/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:20:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:20:59.741853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3e13e-a524-4b82-9d9c-c12be635cd6a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:59.825416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:59.841219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3e13e-a524-4b82-9d9c-c12be635cd6a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:20:59.873360 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf2ed-d63e-4bee-90b3-8632a9a61025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:20:59.874200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf2ed-d63e-4bee-90b3-8632a9a61025 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:20:59.874513 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf2ed-d63e-4bee-90b3-8632a9a61025 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:20:59.874786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf2ed-d63e-4bee-90b3-8632a9a61025 None admin] PATH_INFO: `/v3/roles/d3f29bc0265f45979298aa97cf42ee59` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:20:59.876239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bf2ed-d63e-4bee-90b3-8632a9a61025 None admin] RBAC: Authorizing `identity:get_role(role_id=d3f29bc0265f45979298aa97cf42ee59)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:20:59.877592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bf2ed-d63e-4bee-90b3-8632a9a61025 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:20:59.878974 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 558/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:20:59 2022] GET /identity/v3/roles/d3f29bc0265f45979298aa97cf42ee59 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:20:59.884722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5012d1-a598-4170-b8ee-6a76b656043a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:20:59.894669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:59.983787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5012d1-a598-4170-b8ee-6a76b656043a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:00.016354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcb6b8-fbe2-414d-b888-c032a9a8f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:00.017211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcb6b8-fbe2-414d-b888-c032a9a8f064 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:00.017493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcb6b8-fbe2-414d-b888-c032a9a8f064 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:00.017768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcb6b8-fbe2-414d-b888-c032a9a8f064 None admin] PATH_INFO: `/v3/users/e31d7f3aacf04a0083296700cb259550` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:00.030648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcb6b8-fbe2-414d-b888-c032a9a8f064 None admin] RBAC: Authorizing `identity:get_user(user_id=e31d7f3aacf04a0083296700cb259550)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:00.032087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcb6b8-fbe2-414d-b888-c032a9a8f064 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:00.033714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 556/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:20:59 2022] GET /identity/v3/users/e31d7f3aacf04a0083296700cb259550 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:00.039957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf2ed-d63e-4bee-90b3-8632a9a61025 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:00.136193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf2ed-d63e-4bee-90b3-8632a9a61025 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:00.168461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca026d-a872-4965-bdcb-067d202271bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:00.169090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca026d-a872-4965-bdcb-067d202271bd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:00.169373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca026d-a872-4965-bdcb-067d202271bd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:00.169646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca026d-a872-4965-bdcb-067d202271bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:00.193017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:00.235420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca026d-a872-4965-bdcb-067d202271bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:00.236836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca026d-a872-4965-bdcb-067d202271bd None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:00.337098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 559/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:21:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:21:00.343716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcb6b8-fbe2-414d-b888-c032a9a8f064 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:00.410651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:00.444836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcb6b8-fbe2-414d-b888-c032a9a8f064 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:00.478732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d6f07-f4c8-4153-9347-55f2a168aa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:00.479616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6f07-f4c8-4153-9347-55f2a168aa68 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:00.479901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6f07-f4c8-4153-9347-55f2a168aa68 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:00.480186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6f07-f4c8-4153-9347-55f2a168aa68 None admin] PATH_INFO: `/v3/projects/2a2995d2f14444acb4244be37b1310b1` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:00.481343 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d6f07-f4c8-4153-9347-55f2a168aa68 None admin] RBAC: Authorizing `identity:get_project(project_id=2a2995d2f14444acb4244be37b1310b1)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:00.482802 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d6f07-f4c8-4153-9347-55f2a168aa68 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:00.484471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 557/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:21:00 2022] GET /identity/v3/projects/2a2995d2f14444acb4244be37b1310b1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:00.490684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca026d-a872-4965-bdcb-067d202271bd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:00.543306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:00.587953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca026d-a872-4965-bdcb-067d202271bd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:00.620888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5021f28-ca63-4ef0-87f3-a5598ba80166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:00.621535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5021f28-ca63-4ef0-87f3-a5598ba80166 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:00.621820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5021f28-ca63-4ef0-87f3-a5598ba80166 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:00.622099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5021f28-ca63-4ef0-87f3-a5598ba80166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:00.622953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5021f28-ca63-4ef0-87f3-a5598ba80166 None admin] RBAC: Adding query filter params (role.id=d3f29bc0265f45979298aa97cf42ee59, scope.project.id=2a2995d2f14444acb4244be37b1310b1, user.id=e31d7f3aacf04a0083296700cb259550) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:00.623269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5021f28-ca63-4ef0-87f3-a5598ba80166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:00.624699 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5021f28-ca63-4ef0-87f3-a5598ba80166 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:00.629987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 560/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:21:00 2022] GET /identity/v3/role_assignments?user.id=e31d7f3aacf04a0083296700cb259550&scope.project.id=2a2995d2f14444acb4244be37b1310b1&role.id=d3f29bc0265f45979298aa97cf42ee59 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:02.617867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b38096-dbdf-460c-a969-9ec12ce31e23 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:02.618405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b38096-dbdf-460c-a969-9ec12ce31e23 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:02.618513 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b38096-dbdf-460c-a969-9ec12ce31e23 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:02.619810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 558/1118] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:02.624982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2369156-6c73-4841-b8c0-ea474b026eec None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:02.625386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2369156-6c73-4841-b8c0-ea474b026eec None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:02.625551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2369156-6c73-4841-b8c0-ea474b026eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:02.641862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d2369156-6c73-4841-b8c0-ea474b026eec None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:02.643084 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d2369156-6c73-4841-b8c0-ea474b026eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:02.707448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 561/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:02.731003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b38096-dbdf-460c-a969-9ec12ce31e23 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:02.830619 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b38096-dbdf-460c-a969-9ec12ce31e23 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:02.862537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ba4f-2f57-4e1f-ab69-f570a0d35393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:02.863373 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ba4f-2f57-4e1f-ab69-f570a0d35393 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:02.863656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ba4f-2f57-4e1f-ab69-f570a0d35393 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:02.863931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ba4f-2f57-4e1f-ab69-f570a0d35393 None admin] PATH_INFO: `/v3/roles/d3f29bc0265f45979298aa97cf42ee59` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:02.865927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60ba4f-2f57-4e1f-ab69-f570a0d35393 None admin] RBAC: Authorizing `identity:get_role(role_id=d3f29bc0265f45979298aa97cf42ee59)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:02.867317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60ba4f-2f57-4e1f-ab69-f570a0d35393 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:02.868680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 559/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:21:02 2022] GET /identity/v3/roles/d3f29bc0265f45979298aa97cf42ee59 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:02.874661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2369156-6c73-4841-b8c0-ea474b026eec None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:02.922185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:02.972883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2369156-6c73-4841-b8c0-ea474b026eec None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:03.006171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1dbb0-5f19-48ce-804d-f7cbe30e50de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:03.007060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1dbb0-5f19-48ce-804d-f7cbe30e50de None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:03.007344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1dbb0-5f19-48ce-804d-f7cbe30e50de None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:03.007618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1dbb0-5f19-48ce-804d-f7cbe30e50de None admin] PATH_INFO: `/v3/users/e31d7f3aacf04a0083296700cb259550` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:03.008790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1dbb0-5f19-48ce-804d-f7cbe30e50de None admin] RBAC: Authorizing `identity:get_user(user_id=e31d7f3aacf04a0083296700cb259550)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:03.010212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1dbb0-5f19-48ce-804d-f7cbe30e50de None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:03.011875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 562/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:21:02 2022] GET /identity/v3/users/e31d7f3aacf04a0083296700cb259550 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:03.017543 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ba4f-2f57-4e1f-ab69-f570a0d35393 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:03.020368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:03.114101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ba4f-2f57-4e1f-ab69-f570a0d35393 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:03.146644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e068e2-a902-4186-8073-cd00de3900a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:03.147487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e068e2-a902-4186-8073-cd00de3900a1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:03.147770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e068e2-a902-4186-8073-cd00de3900a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:03.148042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e068e2-a902-4186-8073-cd00de3900a1 None admin] PATH_INFO: `/v3/projects/2a2995d2f14444acb4244be37b1310b1` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:03.149216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e068e2-a902-4186-8073-cd00de3900a1 None admin] RBAC: Authorizing `identity:get_project(project_id=2a2995d2f14444acb4244be37b1310b1)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:03.150665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e068e2-a902-4186-8073-cd00de3900a1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:03.152338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 560/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:21:03 2022] GET /identity/v3/projects/2a2995d2f14444acb4244be37b1310b1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:03.158258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1dbb0-5f19-48ce-804d-f7cbe30e50de None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:03.255837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1dbb0-5f19-48ce-804d-f7cbe30e50de None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:03.271557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:03.289332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62086b-323f-49fa-8796-5db99bf98297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:03.290202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62086b-323f-49fa-8796-5db99bf98297 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:03.290530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62086b-323f-49fa-8796-5db99bf98297 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:03.290814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62086b-323f-49fa-8796-5db99bf98297 None admin] PATH_INFO: `/v3/projects/2a2995d2f14444acb4244be37b1310b1/users/e31d7f3aacf04a0083296700cb259550/roles/d3f29bc0265f45979298aa97cf42ee59` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:03.292994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62086b-323f-49fa-8796-5db99bf98297 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a2995d2f14444acb4244be37b1310b1, user_id=e31d7f3aacf04a0083296700cb259550, role_id=d3f29bc0265f45979298aa97cf42ee59)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:03.294440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62086b-323f-49fa-8796-5db99bf98297 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:03.308206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 563/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:21:03 2022] PUT /identity/v3/projects/2a2995d2f14444acb4244be37b1310b1/users/e31d7f3aacf04a0083296700cb259550/roles/d3f29bc0265f45979298aa97cf42ee59 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:21:05.277141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f41557-0f34-4053-beb4-a9e50504c945 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:05.277701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f41557-0f34-4053-beb4-a9e50504c945 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:05.277701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f41557-0f34-4053-beb4-a9e50504c945 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:05.279092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 561/1124] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:05.284102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dfccc-6a5e-49d3-a8b9-ee0b84a2a58a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:05.284466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dfccc-6a5e-49d3-a8b9-ee0b84a2a58a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:05.284655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dfccc-6a5e-49d3-a8b9-ee0b84a2a58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:05.302389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bb8dfccc-6a5e-49d3-a8b9-ee0b84a2a58a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:05.303575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bb8dfccc-6a5e-49d3-a8b9-ee0b84a2a58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:05.367323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 564/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:05.389901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f41557-0f34-4053-beb4-a9e50504c945 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:05.461090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:05.492785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f41557-0f34-4053-beb4-a9e50504c945 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:05.526004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ab21e-9467-4190-a432-70c1df1ca16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:05.527104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ab21e-9467-4190-a432-70c1df1ca16c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:05.527446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ab21e-9467-4190-a432-70c1df1ca16c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:05.527881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ab21e-9467-4190-a432-70c1df1ca16c None admin] PATH_INFO: `/v3/roles/d3f29bc0265f45979298aa97cf42ee59` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:05.529694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ab21e-9467-4190-a432-70c1df1ca16c None admin] RBAC: Authorizing `identity:get_role(role_id=d3f29bc0265f45979298aa97cf42ee59)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:05.531088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ab21e-9467-4190-a432-70c1df1ca16c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:05.532461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 562/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:21:05 2022] GET /identity/v3/roles/d3f29bc0265f45979298aa97cf42ee59 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:05.538998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dfccc-6a5e-49d3-a8b9-ee0b84a2a58a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:05.635138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dfccc-6a5e-49d3-a8b9-ee0b84a2a58a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:05.642133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:05.669577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6104b-2fda-4bc5-9c7a-85877a23ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:05.670472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6104b-2fda-4bc5-9c7a-85877a23ad0a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:05.670998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6104b-2fda-4bc5-9c7a-85877a23ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:05.671277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6104b-2fda-4bc5-9c7a-85877a23ad0a None admin] PATH_INFO: `/v3/users/e31d7f3aacf04a0083296700cb259550` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:05.672448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6104b-2fda-4bc5-9c7a-85877a23ad0a None admin] RBAC: Authorizing `identity:get_user(user_id=e31d7f3aacf04a0083296700cb259550)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:05.673868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6104b-2fda-4bc5-9c7a-85877a23ad0a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:05.675519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 565/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:21:05 2022] GET /identity/v3/users/e31d7f3aacf04a0083296700cb259550 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:05.681304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ab21e-9467-4190-a432-70c1df1ca16c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:05.776960 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ab21e-9467-4190-a432-70c1df1ca16c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:05.809751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6f94b-7104-4602-9497-11b296597c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:05.810325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6f94b-7104-4602-9497-11b296597c62 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:05.810639 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6f94b-7104-4602-9497-11b296597c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:05.810916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6f94b-7104-4602-9497-11b296597c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:05.818605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:05.877011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6f94b-7104-4602-9497-11b296597c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:05.878482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6f94b-7104-4602-9497-11b296597c62 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:05.973014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 563/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:21:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:21:05.979370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6104b-2fda-4bc5-9c7a-85877a23ad0a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:06.076292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6104b-2fda-4bc5-9c7a-85877a23ad0a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:06.108991 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cd19d-ef86-47dd-a15f-6e8233ca267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:06.109830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cd19d-ef86-47dd-a15f-6e8233ca267a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:06.110114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cd19d-ef86-47dd-a15f-6e8233ca267a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:06.110416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cd19d-ef86-47dd-a15f-6e8233ca267a None admin] PATH_INFO: `/v3/projects/2a2995d2f14444acb4244be37b1310b1` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:06.111681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cd19d-ef86-47dd-a15f-6e8233ca267a None admin] RBAC: Authorizing `identity:get_project(project_id=2a2995d2f14444acb4244be37b1310b1)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:06.113113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cd19d-ef86-47dd-a15f-6e8233ca267a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:06.114844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 566/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:21:05 2022] GET /identity/v3/projects/2a2995d2f14444acb4244be37b1310b1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:06.120819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6f94b-7104-4602-9497-11b296597c62 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:06.160362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:06.219419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6f94b-7104-4602-9497-11b296597c62 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:06.253056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd97d9b-8a63-4f5e-a46a-34bbe31501ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:06.253702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd97d9b-8a63-4f5e-a46a-34bbe31501ff None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:06.253989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd97d9b-8a63-4f5e-a46a-34bbe31501ff None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:06.254267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd97d9b-8a63-4f5e-a46a-34bbe31501ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:06.255146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd97d9b-8a63-4f5e-a46a-34bbe31501ff None admin] RBAC: Adding query filter params (role.id=d3f29bc0265f45979298aa97cf42ee59, scope.project.id=2a2995d2f14444acb4244be37b1310b1, user.id=e31d7f3aacf04a0083296700cb259550) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:06.255462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd97d9b-8a63-4f5e-a46a-34bbe31501ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:06.256889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd97d9b-8a63-4f5e-a46a-34bbe31501ff None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:06.262667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 564/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:21:06 2022] GET /identity/v3/role_assignments?user.id=e31d7f3aacf04a0083296700cb259550&scope.project.id=2a2995d2f14444acb4244be37b1310b1&role.id=d3f29bc0265f45979298aa97cf42ee59 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:08.274011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bd928-e2db-4fbf-839a-e8d7d7469351 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:08.274577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bd928-e2db-4fbf-839a-e8d7d7469351 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:08.274577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bd928-e2db-4fbf-839a-e8d7d7469351 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:08.275935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 567/1131] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:08.281045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b9b0-9b2a-45d9-991d-0523314bea6f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:08.281415 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b9b0-9b2a-45d9-991d-0523314bea6f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:08.281601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b9b0-9b2a-45d9-991d-0523314bea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:08.299059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a635b9b0-9b2a-45d9-991d-0523314bea6f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:08.300564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a635b9b0-9b2a-45d9-991d-0523314bea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:08.364610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 565/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:08.388003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bd928-e2db-4fbf-839a-e8d7d7469351 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:08.430979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:08.486949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bd928-e2db-4fbf-839a-e8d7d7469351 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:08.519918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af878938-b90d-4eeb-bc63-c64f14efe667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:08.520721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af878938-b90d-4eeb-bc63-c64f14efe667 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:08.521006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af878938-b90d-4eeb-bc63-c64f14efe667 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:08.521285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af878938-b90d-4eeb-bc63-c64f14efe667 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:08.522467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af878938-b90d-4eeb-bc63-c64f14efe667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:08.523887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af878938-b90d-4eeb-bc63-c64f14efe667 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:08.525544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 568/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:21:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:08.531063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635b9b0-9b2a-45d9-991d-0523314bea6f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:08.561908 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:08.629322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635b9b0-9b2a-45d9-991d-0523314bea6f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:08.662558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147f1f1-ae82-46a0-a6ec-f78cacc7eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:08.663241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147f1f1-ae82-46a0-a6ec-f78cacc7eddb None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:08.663529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147f1f1-ae82-46a0-a6ec-f78cacc7eddb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:08.663807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147f1f1-ae82-46a0-a6ec-f78cacc7eddb None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:08.664520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147f1f1-ae82-46a0-a6ec-f78cacc7eddb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:08.665946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147f1f1-ae82-46a0-a6ec-f78cacc7eddb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:08.691113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 566/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:21:08 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:21:10.726063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bf32e-46dc-490c-8e1a-4cdd3d0fc1b8 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:10.726606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bf32e-46dc-490c-8e1a-4cdd3d0fc1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:10.726694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bf32e-46dc-490c-8e1a-4cdd3d0fc1b8 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:10.728020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 569/1135] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:10.733105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82879e6-9670-4f35-b6d2-876a7744c1d5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:10.733472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82879e6-9670-4f35-b6d2-876a7744c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:10.733662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82879e6-9670-4f35-b6d2-876a7744c1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:10.750467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b82879e6-9670-4f35-b6d2-876a7744c1d5 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:10.751673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b82879e6-9670-4f35-b6d2-876a7744c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:10.816013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 567/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:10.840870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bf32e-46dc-490c-8e1a-4cdd3d0fc1b8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:10.939496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bf32e-46dc-490c-8e1a-4cdd3d0fc1b8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:10.949759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:10.974032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55e368-fef1-49b9-a1ae-e452fe56fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:10.974910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e368-fef1-49b9-a1ae-e452fe56fa22 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:10.975195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e368-fef1-49b9-a1ae-e452fe56fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:10.975471 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e368-fef1-49b9-a1ae-e452fe56fa22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:10.980470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55e368-fef1-49b9-a1ae-e452fe56fa22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:10.982202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55e368-fef1-49b9-a1ae-e452fe56fa22 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:10.984379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 570/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:10.991305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82879e6-9670-4f35-b6d2-876a7744c1d5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:11.006076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:11.088501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82879e6-9670-4f35-b6d2-876a7744c1d5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:11.121348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c2a41-e486-4fe5-9130-b45db669385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:11.121955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c2a41-e486-4fe5-9130-b45db669385f None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:11.122243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c2a41-e486-4fe5-9130-b45db669385f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:11.122551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c2a41-e486-4fe5-9130-b45db669385f None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:11.123266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c2a41-e486-4fe5-9130-b45db669385f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:11.124696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c2a41-e486-4fe5-9130-b45db669385f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:11.144066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 568/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:21:10 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:21:13.205467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368f2c8-4e97-4e60-9d05-ec6f7884a4d7 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:13.205998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368f2c8-4e97-4e60-9d05-ec6f7884a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:13.205998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368f2c8-4e97-4e60-9d05-ec6f7884a4d7 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:13.207965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 571/1139] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:13.213146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61099-0440-45cb-8d25-b4fec184ed17 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:13.213543 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61099-0440-45cb-8d25-b4fec184ed17 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:13.213697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61099-0440-45cb-8d25-b4fec184ed17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:13.230440 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c8e61099-0440-45cb-8d25-b4fec184ed17 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:13.231614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c8e61099-0440-45cb-8d25-b4fec184ed17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:13.307566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:13.313043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 569/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:13.336891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368f2c8-4e97-4e60-9d05-ec6f7884a4d7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:13.435171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368f2c8-4e97-4e60-9d05-ec6f7884a4d7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:13.467769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611bb16-0513-4998-a277-d72531619c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:13.468476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611bb16-0513-4998-a277-d72531619c67 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:13.468756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611bb16-0513-4998-a277-d72531619c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:13.469029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611bb16-0513-4998-a277-d72531619c67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:13.479454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611bb16-0513-4998-a277-d72531619c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-b611bb16-0513-4998-a277-d72531619c67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:21:13.486919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:21:13.487999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:21:13.488893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 572/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:21:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:21:13.494078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61099-0440-45cb-8d25-b4fec184ed17 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:13.596780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61099-0440-45cb-8d25-b4fec184ed17 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:13.628799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332fe1e-62d8-4b4d-963c-a26bd88a4263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:13.629972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332fe1e-62d8-4b4d-963c-a26bd88a4263 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:13.630252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332fe1e-62d8-4b4d-963c-a26bd88a4263 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:13.630549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332fe1e-62d8-4b4d-963c-a26bd88a4263 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:13.631287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332fe1e-62d8-4b4d-963c-a26bd88a4263 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:13.631589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332fe1e-62d8-4b4d-963c-a26bd88a4263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:13.632953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332fe1e-62d8-4b4d-963c-a26bd88a4263 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:13.640736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 570/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:21:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:13.647210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611bb16-0513-4998-a277-d72531619c67 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:13.687478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:13.745964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611bb16-0513-4998-a277-d72531619c67 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:13.778795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c9d51-eb80-4793-83e3-230e9f65f902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:13.779650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9d51-eb80-4793-83e3-230e9f65f902 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:13.779934 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9d51-eb80-4793-83e3-230e9f65f902 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:13.780212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9d51-eb80-4793-83e3-230e9f65f902 None admin] PATH_INFO: `/v3/users/73dfdd91a64d47f186feb15a6de5805f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:13.792896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c9d51-eb80-4793-83e3-230e9f65f902 None admin] RBAC: Authorizing `identity:get_user(user_id=73dfdd91a64d47f186feb15a6de5805f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:13.794329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c9d51-eb80-4793-83e3-230e9f65f902 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:13.796270 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 573/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:21:13 2022] GET /identity/v3/users/73dfdd91a64d47f186feb15a6de5805f => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:13.802055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332fe1e-62d8-4b4d-963c-a26bd88a4263 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:13.878103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:13.930701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332fe1e-62d8-4b4d-963c-a26bd88a4263 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:13.967837 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463defb2-352d-46aa-924c-21a94c23fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:13.968482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463defb2-352d-46aa-924c-21a94c23fd24 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:13.968764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463defb2-352d-46aa-924c-21a94c23fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:13.969039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463defb2-352d-46aa-924c-21a94c23fd24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:14.053730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463defb2-352d-46aa-924c-21a94c23fd24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:14.055839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463defb2-352d-46aa-924c-21a94c23fd24 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:14.133853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:14.177997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 571/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:21:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:21:14.183976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c9d51-eb80-4793-83e3-230e9f65f902 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:14.274069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:14.280060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c9d51-eb80-4793-83e3-230e9f65f902 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:14.313408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1abb7-3520-4f93-ac12-2d757b157e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:14.314194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1abb7-3520-4f93-ac12-2d757b157e08 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:14.314501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1abb7-3520-4f93-ac12-2d757b157e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:14.314782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1abb7-3520-4f93-ac12-2d757b157e08 None admin] PATH_INFO: `/v3/projects/dbf32c9d24a544b095e145d76e956655` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:14.315947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1abb7-3520-4f93-ac12-2d757b157e08 None admin] RBAC: Authorizing `identity:get_project(project_id=dbf32c9d24a544b095e145d76e956655)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:14.317387 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1abb7-3520-4f93-ac12-2d757b157e08 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:14.319263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 574/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:21:14 2022] GET /identity/v3/projects/dbf32c9d24a544b095e145d76e956655 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:14.325411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463defb2-352d-46aa-924c-21a94c23fd24 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:14.422109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463defb2-352d-46aa-924c-21a94c23fd24 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:14.454856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6214f-615d-4f2e-b976-2dc42b123e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:14.455495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6214f-615d-4f2e-b976-2dc42b123e45 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:14.455777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6214f-615d-4f2e-b976-2dc42b123e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:14.456047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6214f-615d-4f2e-b976-2dc42b123e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:14.456862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6214f-615d-4f2e-b976-2dc42b123e45 None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=dbf32c9d24a544b095e145d76e956655, user.id=73dfdd91a64d47f186feb15a6de5805f) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:14.457170 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6214f-615d-4f2e-b976-2dc42b123e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:14.458634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6214f-615d-4f2e-b976-2dc42b123e45 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:14.463950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 572/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:21:14 2022] GET /identity/v3/role_assignments?user.id=73dfdd91a64d47f186feb15a6de5805f&scope.project.id=dbf32c9d24a544b095e145d76e956655&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:16.447153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f32b-93d5-4e0c-8d8e-af7f89bc4385 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:16.447705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f32b-93d5-4e0c-8d8e-af7f89bc4385 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:16.447705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f32b-93d5-4e0c-8d8e-af7f89bc4385 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:16.449076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 575/1147] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:16.455546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2379f5-9307-45d5-8920-4fe0addf412e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:16.456048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2379f5-9307-45d5-8920-4fe0addf412e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:16.456552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2379f5-9307-45d5-8920-4fe0addf412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:16.483191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ff2379f5-9307-45d5-8920-4fe0addf412e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:16.485240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ff2379f5-9307-45d5-8920-4fe0addf412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:16.519459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:16.573284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 573/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:16.598857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f32b-93d5-4e0c-8d8e-af7f89bc4385 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:16.719913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f32b-93d5-4e0c-8d8e-af7f89bc4385 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:16.769131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff13966-352e-4fe3-ac93-657d6e9169bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:16.770150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff13966-352e-4fe3-ac93-657d6e9169bd None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:16.770468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff13966-352e-4fe3-ac93-657d6e9169bd None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:16.770779 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff13966-352e-4fe3-ac93-657d6e9169bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:16.781401 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff13966-352e-4fe3-ac93-657d6e9169bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4ff13966-352e-4fe3-ac93-657d6e9169bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:21:16.789758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:21:16.790980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:21:16.792224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 576/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:21:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:21:16.797649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2379f5-9307-45d5-8920-4fe0addf412e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:16.901097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2379f5-9307-45d5-8920-4fe0addf412e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:16.935970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16c6aa-1fe1-45ca-a965-1a4b29b719d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:16.936632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16c6aa-1fe1-45ca-a965-1a4b29b719d8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:16.936920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16c6aa-1fe1-45ca-a965-1a4b29b719d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:16.937198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16c6aa-1fe1-45ca-a965-1a4b29b719d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:16.937947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16c6aa-1fe1-45ca-a965-1a4b29b719d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:16.938258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16c6aa-1fe1-45ca-a965-1a4b29b719d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:16.939659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16c6aa-1fe1-45ca-a965-1a4b29b719d8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:16.947708 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 574/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:16.953472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff13966-352e-4fe3-ac93-657d6e9169bd None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:16.979472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:17.051804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff13966-352e-4fe3-ac93-657d6e9169bd None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:17.083880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318e3ae-b62b-4ba2-9e93-064b2e86ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:17.084735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318e3ae-b62b-4ba2-9e93-064b2e86ba22 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:17.085017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318e3ae-b62b-4ba2-9e93-064b2e86ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:17.085291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318e3ae-b62b-4ba2-9e93-064b2e86ba22 None admin] PATH_INFO: `/v3/users/73dfdd91a64d47f186feb15a6de5805f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:17.086506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318e3ae-b62b-4ba2-9e93-064b2e86ba22 None admin] RBAC: Authorizing `identity:get_user(user_id=73dfdd91a64d47f186feb15a6de5805f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:17.087929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318e3ae-b62b-4ba2-9e93-064b2e86ba22 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:17.089546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 577/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:21:16 2022] GET /identity/v3/users/73dfdd91a64d47f186feb15a6de5805f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:17.095259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16c6aa-1fe1-45ca-a965-1a4b29b719d8 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:17.114943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:17.193508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16c6aa-1fe1-45ca-a965-1a4b29b719d8 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:17.226633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c78341-7c58-4f79-94ae-6b07a42c6e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:17.227503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c78341-7c58-4f79-94ae-6b07a42c6e7d None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:17.227789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c78341-7c58-4f79-94ae-6b07a42c6e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:17.228064 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c78341-7c58-4f79-94ae-6b07a42c6e7d None admin] PATH_INFO: `/v3/projects/dbf32c9d24a544b095e145d76e956655` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:17.229238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c78341-7c58-4f79-94ae-6b07a42c6e7d None admin] RBAC: Authorizing `identity:get_project(project_id=dbf32c9d24a544b095e145d76e956655)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:17.230742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c78341-7c58-4f79-94ae-6b07a42c6e7d None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:17.232381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 575/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:21:17 2022] GET /identity/v3/projects/dbf32c9d24a544b095e145d76e956655 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:17.238539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318e3ae-b62b-4ba2-9e93-064b2e86ba22 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:17.326756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:17.336400 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318e3ae-b62b-4ba2-9e93-064b2e86ba22 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:17.367906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb898f-0480-44dc-a665-054d4dc23aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:17.368773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb898f-0480-44dc-a665-054d4dc23aa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:17.369055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb898f-0480-44dc-a665-054d4dc23aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:17.369332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb898f-0480-44dc-a665-054d4dc23aa4 None admin] PATH_INFO: `/v3/projects/dbf32c9d24a544b095e145d76e956655/users/73dfdd91a64d47f186feb15a6de5805f/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:17.371266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb898f-0480-44dc-a665-054d4dc23aa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbf32c9d24a544b095e145d76e956655, user_id=73dfdd91a64d47f186feb15a6de5805f, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:17.372679 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb898f-0480-44dc-a665-054d4dc23aa4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:17.385744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 578/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:21:17 2022] PUT /identity/v3/projects/dbf32c9d24a544b095e145d76e956655/users/73dfdd91a64d47f186feb15a6de5805f/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:21:19.411203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55df0a-2c08-4ae4-bdb9-8606b7a72684 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:19.411734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55df0a-2c08-4ae4-bdb9-8606b7a72684 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:19.411822 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55df0a-2c08-4ae4-bdb9-8606b7a72684 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:19.413129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 576/1154] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:19.418344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287414d2-30b7-41f4-9b57-cf9105195ee2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:19.418800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287414d2-30b7-41f4-9b57-cf9105195ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:19.418923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287414d2-30b7-41f4-9b57-cf9105195ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:19.435431 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-287414d2-30b7-41f4-9b57-cf9105195ee2 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:19.436598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-287414d2-30b7-41f4-9b57-cf9105195ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:19.501029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 579/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:19.525580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55df0a-2c08-4ae4-bdb9-8606b7a72684 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:19.610674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:19.626129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55df0a-2c08-4ae4-bdb9-8606b7a72684 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:19.659375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646694cd-5d22-4499-8016-6f3cd4f74122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:19.660183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646694cd-5d22-4499-8016-6f3cd4f74122 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:19.660472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646694cd-5d22-4499-8016-6f3cd4f74122 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:19.660749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646694cd-5d22-4499-8016-6f3cd4f74122 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:19.671338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646694cd-5d22-4499-8016-6f3cd4f74122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-646694cd-5d22-4499-8016-6f3cd4f74122 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:21:19.678912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:21:19.680012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:21:19.680928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 577/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:21:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:21:19.686329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287414d2-30b7-41f4-9b57-cf9105195ee2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:19.765186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:19.785355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287414d2-30b7-41f4-9b57-cf9105195ee2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:19.823924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43899821-7fff-45b8-a0b1-3aeed7331348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:19.824592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43899821-7fff-45b8-a0b1-3aeed7331348 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:19.824874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43899821-7fff-45b8-a0b1-3aeed7331348 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:19.825150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43899821-7fff-45b8-a0b1-3aeed7331348 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:19.825884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43899821-7fff-45b8-a0b1-3aeed7331348 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:19.826193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43899821-7fff-45b8-a0b1-3aeed7331348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:19.827581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43899821-7fff-45b8-a0b1-3aeed7331348 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:19.836717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 580/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:21:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:19.842481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646694cd-5d22-4499-8016-6f3cd4f74122 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:19.938709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646694cd-5d22-4499-8016-6f3cd4f74122 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:19.971331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd441bc-85a9-49d2-80ff-6a019cfce131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:19.972180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd441bc-85a9-49d2-80ff-6a019cfce131 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:19.972467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd441bc-85a9-49d2-80ff-6a019cfce131 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:19.972746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd441bc-85a9-49d2-80ff-6a019cfce131 None admin] PATH_INFO: `/v3/users/73dfdd91a64d47f186feb15a6de5805f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:19.973923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd441bc-85a9-49d2-80ff-6a019cfce131 None admin] RBAC: Authorizing `identity:get_user(user_id=73dfdd91a64d47f186feb15a6de5805f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:19.975383 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd441bc-85a9-49d2-80ff-6a019cfce131 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:19.976980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 578/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:21:19 2022] GET /identity/v3/users/73dfdd91a64d47f186feb15a6de5805f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:19.982692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43899821-7fff-45b8-a0b1-3aeed7331348 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:20.079442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43899821-7fff-45b8-a0b1-3aeed7331348 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:20.110994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3c9e-af79-47c5-bf62-1dab8931f7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:20.111627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3c9e-af79-47c5-bf62-1dab8931f7ab None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:20.111911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3c9e-af79-47c5-bf62-1dab8931f7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:20.112188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b3c9e-af79-47c5-bf62-1dab8931f7ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:20.126292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:20.178496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b3c9e-af79-47c5-bf62-1dab8931f7ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:20.179911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b3c9e-af79-47c5-bf62-1dab8931f7ab None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:20.274521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 581/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:21:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:21:20.280314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd441bc-85a9-49d2-80ff-6a019cfce131 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:20.296318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:20.377468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd441bc-85a9-49d2-80ff-6a019cfce131 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:20.410756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d870c5-f27a-4209-8591-c6d23de221db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:20.411595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d870c5-f27a-4209-8591-c6d23de221db None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:20.412122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d870c5-f27a-4209-8591-c6d23de221db None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:20.412122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d870c5-f27a-4209-8591-c6d23de221db None admin] PATH_INFO: `/v3/projects/dbf32c9d24a544b095e145d76e956655` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:20.413282 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d870c5-f27a-4209-8591-c6d23de221db None admin] RBAC: Authorizing `identity:get_project(project_id=dbf32c9d24a544b095e145d76e956655)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:20.414745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d870c5-f27a-4209-8591-c6d23de221db None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:20.416423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 579/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:21:20 2022] GET /identity/v3/projects/dbf32c9d24a544b095e145d76e956655 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:20.422641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3c9e-af79-47c5-bf62-1dab8931f7ab None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:20.467329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:20.520218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b3c9e-af79-47c5-bf62-1dab8931f7ab None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:20.552870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df77c3-c264-47cc-9b73-3d58ba3a0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:20.553510 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df77c3-c264-47cc-9b73-3d58ba3a0da4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:20.553796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df77c3-c264-47cc-9b73-3d58ba3a0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:20.554072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df77c3-c264-47cc-9b73-3d58ba3a0da4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:20.554927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df77c3-c264-47cc-9b73-3d58ba3a0da4 None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=dbf32c9d24a544b095e145d76e956655, user.id=73dfdd91a64d47f186feb15a6de5805f) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:20.555245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df77c3-c264-47cc-9b73-3d58ba3a0da4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:20.556673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df77c3-c264-47cc-9b73-3d58ba3a0da4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:20.564185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 582/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:21:20 2022] GET /identity/v3/role_assignments?user.id=73dfdd91a64d47f186feb15a6de5805f&scope.project.id=dbf32c9d24a544b095e145d76e956655&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:22.583926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6b77b-0d8d-4b3e-a6a4-a5ea1a4d7f70 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:22.584348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6b77b-0d8d-4b3e-a6a4-a5ea1a4d7f70 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:22.584479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6b77b-0d8d-4b3e-a6a4-a5ea1a4d7f70 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:22.585858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 580/1162] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:22.591083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3237c5-2885-4ff3-98cb-0895204354f1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:22.591509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3237c5-2885-4ff3-98cb-0895204354f1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:22.591620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3237c5-2885-4ff3-98cb-0895204354f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:22.607813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7c3237c5-2885-4ff3-98cb-0895204354f1 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:22.608978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7c3237c5-2885-4ff3-98cb-0895204354f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:22.672149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 583/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:22.694288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6b77b-0d8d-4b3e-a6a4-a5ea1a4d7f70 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:22.773620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:22.792411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6b77b-0d8d-4b3e-a6a4-a5ea1a4d7f70 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:22.825592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a08341-da5e-4fc1-b879-161de7f0b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:22.826168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a08341-da5e-4fc1-b879-161de7f0b81f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:22.826485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a08341-da5e-4fc1-b879-161de7f0b81f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:22.826767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a08341-da5e-4fc1-b879-161de7f0b81f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:22.893394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a08341-da5e-4fc1-b879-161de7f0b81f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:22.894897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a08341-da5e-4fc1-b879-161de7f0b81f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:22.971992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:22.991591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 581/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:21:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:21:22.997554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3237c5-2885-4ff3-98cb-0895204354f1 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:23.035853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:23.094272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3237c5-2885-4ff3-98cb-0895204354f1 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:23.126925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206c9ec-6bbe-418f-8b8f-873c61de3ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:23.127704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206c9ec-6bbe-418f-8b8f-873c61de3ecc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:23.127984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206c9ec-6bbe-418f-8b8f-873c61de3ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:23.128258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206c9ec-6bbe-418f-8b8f-873c61de3ecc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:23.135283 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206c9ec-6bbe-418f-8b8f-873c61de3ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:23.136710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206c9ec-6bbe-418f-8b8f-873c61de3ecc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a206c9ec-6bbe-418f-8b8f-873c61de3ecc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:21:23.150680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:21:23.151849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:21:23.152958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 584/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Jun 24 10:21:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:21:23.157720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a08341-da5e-4fc1-b879-161de7f0b81f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:23.254201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a08341-da5e-4fc1-b879-161de7f0b81f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:23.286570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc151e5-eaae-483f-b5f9-aaa43e2152e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:23.287212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc151e5-eaae-483f-b5f9-aaa43e2152e9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:23.287495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc151e5-eaae-483f-b5f9-aaa43e2152e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:23.287770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc151e5-eaae-483f-b5f9-aaa43e2152e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:23.288476 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc151e5-eaae-483f-b5f9-aaa43e2152e9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:23.288778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc151e5-eaae-483f-b5f9-aaa43e2152e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:23.290204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc151e5-eaae-483f-b5f9-aaa43e2152e9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:23.297374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 582/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Jun 24 10:21:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:25.315624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c07ad-b238-49c2-b0f8-7ba91281173c None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:25.316179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c07ad-b238-49c2-b0f8-7ba91281173c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:25.316179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c07ad-b238-49c2-b0f8-7ba91281173c None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:25.317532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 585/1167] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:25.322636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfac230-57ce-4425-82ab-449e75d79310 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:25.323073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfac230-57ce-4425-82ab-449e75d79310 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:25.323193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfac230-57ce-4425-82ab-449e75d79310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:25.339961 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ddfac230-57ce-4425-82ab-449e75d79310 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:25.341136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ddfac230-57ce-4425-82ab-449e75d79310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:25.381750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:25.406085 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 583/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:25.429633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c07ad-b238-49c2-b0f8-7ba91281173c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:25.523296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:25.528361 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c07ad-b238-49c2-b0f8-7ba91281173c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:25.560359 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebda1d-a41d-4ded-947f-c2500e441abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:25.561029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebda1d-a41d-4ded-947f-c2500e441abe None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:25.561314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebda1d-a41d-4ded-947f-c2500e441abe None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:25.561585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebda1d-a41d-4ded-947f-c2500e441abe None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:25.562317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebda1d-a41d-4ded-947f-c2500e441abe None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:25.563874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebda1d-a41d-4ded-947f-c2500e441abe None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:25.578802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 586/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Fri Jun 24 10:21:25 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:21:27.598938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbbf6b-aab2-4a1b-9e23-a8ba2a4c2617 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:27.599435 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbbf6b-aab2-4a1b-9e23-a8ba2a4c2617 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:27.599527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbbf6b-aab2-4a1b-9e23-a8ba2a4c2617 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:27.600899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 584/1170] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:27.612675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef057667-7b72-4ab1-890f-b147ff5c3347 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:27.613151 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef057667-7b72-4ab1-890f-b147ff5c3347 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:27.613254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef057667-7b72-4ab1-890f-b147ff5c3347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:27.629731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ef057667-7b72-4ab1-890f-b147ff5c3347 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:27.630957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ef057667-7b72-4ab1-890f-b147ff5c3347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:27.695820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 587/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:27.719202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbbf6b-aab2-4a1b-9e23-a8ba2a4c2617 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:27.816518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbbf6b-aab2-4a1b-9e23-a8ba2a4c2617 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:27.848684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b6c6a-ea52-46e0-bc46-eace3a2b1fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:27.849456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6c6a-ea52-46e0-bc46-eace3a2b1fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:27.849737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6c6a-ea52-46e0-bc46-eace3a2b1fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:27.850014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6c6a-ea52-46e0-bc46-eace3a2b1fb6 None admin] PATH_INFO: `/v3/domains/52b8aff8f72142cbb1662bda09c98477` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:27.859942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b6c6a-ea52-46e0-bc46-eace3a2b1fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=52b8aff8f72142cbb1662bda09c98477)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:27.861378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b6c6a-ea52-46e0-bc46-eace3a2b1fb6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:27.863524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 585/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Fri Jun 24 10:21:27 2022] GET /identity/v3/domains/52b8aff8f72142cbb1662bda09c98477 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:27.869113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef057667-7b72-4ab1-890f-b147ff5c3347 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:27.952564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:27.965278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef057667-7b72-4ab1-890f-b147ff5c3347 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:28.004674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606f1b-a5fe-406b-ac27-7d249af9eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:28.005326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606f1b-a5fe-406b-ac27-7d249af9eab1 None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:28.005611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606f1b-a5fe-406b-ac27-7d249af9eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:28.005886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606f1b-a5fe-406b-ac27-7d249af9eab1 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:28.006609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606f1b-a5fe-406b-ac27-7d249af9eab1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:28.008025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606f1b-a5fe-406b-ac27-7d249af9eab1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:28.032520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 588/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:21:27 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:21:30.068270 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431119ae-75c5-43f0-a415-0c73af360ecc None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:30.068776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431119ae-75c5-43f0-a415-0c73af360ecc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:30.068884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431119ae-75c5-43f0-a415-0c73af360ecc None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:30.070198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 586/1174] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:30.075304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e716e-4970-478b-9791-a0518525e4ce None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:30.075687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e716e-4970-478b-9791-a0518525e4ce None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:30.075864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e716e-4970-478b-9791-a0518525e4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:30.092767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ab4e716e-4970-478b-9791-a0518525e4ce None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:30.093935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ab4e716e-4970-478b-9791-a0518525e4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:30.156978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 589/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:21:30.181786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431119ae-75c5-43f0-a415-0c73af360ecc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:30.218076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:30.281230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431119ae-75c5-43f0-a415-0c73af360ecc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:30.313134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bf0c5-2d93-48fe-ab8e-21cc1792e9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:30.313982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf0c5-2d93-48fe-ab8e-21cc1792e9df None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:30.314266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf0c5-2d93-48fe-ab8e-21cc1792e9df None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:30.314570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf0c5-2d93-48fe-ab8e-21cc1792e9df None admin] PATH_INFO: `/v3/domains/52b8aff8f72142cbb1662bda09c98477` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:30.316226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bf0c5-2d93-48fe-ab8e-21cc1792e9df None admin] RBAC: Authorizing `identity:get_domain(domain_id=52b8aff8f72142cbb1662bda09c98477)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:30.317650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bf0c5-2d93-48fe-ab8e-21cc1792e9df None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:30.319326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 587/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Fri Jun 24 10:21:30 2022] GET /identity/v3/domains/52b8aff8f72142cbb1662bda09c98477 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:30.325017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e716e-4970-478b-9791-a0518525e4ce None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:30.391879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:30.423739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e716e-4970-478b-9791-a0518525e4ce None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:30.455371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0315a5-c36f-497a-be2c-e3342803162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:30.456618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0315a5-c36f-497a-be2c-e3342803162b None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:30.456992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0315a5-c36f-497a-be2c-e3342803162b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:30.457271 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0315a5-c36f-497a-be2c-e3342803162b None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:30.457971 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0315a5-c36f-497a-be2c-e3342803162b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:30.459412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0315a5-c36f-497a-be2c-e3342803162b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:30.478441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 590/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:21:30 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:21:32.504501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55f17-5dd5-4152-b589-e4563d967fe0 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:32.505048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55f17-5dd5-4152-b589-e4563d967fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:32.505048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55f17-5dd5-4152-b589-e4563d967fe0 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:32.506457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 588/1178] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:32.511530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930a37b-5b93-4f7e-aaa1-201e6c9be844 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:32.511954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930a37b-5b93-4f7e-aaa1-201e6c9be844 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:32.512097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930a37b-5b93-4f7e-aaa1-201e6c9be844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:32.528984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8930a37b-5b93-4f7e-aaa1-201e6c9be844 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:32.530167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8930a37b-5b93-4f7e-aaa1-201e6c9be844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:32.595902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 591/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:32.620192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f55f17-5dd5-4152-b589-e4563d967fe0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:32.718213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f55f17-5dd5-4152-b589-e4563d967fe0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:32.720462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:32.750559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac521693-c96c-49be-a9a7-5d56dd507b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:32.751324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac521693-c96c-49be-a9a7-5d56dd507b88 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:32.751604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac521693-c96c-49be-a9a7-5d56dd507b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:32.751875 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac521693-c96c-49be-a9a7-5d56dd507b88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:32.762007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac521693-c96c-49be-a9a7-5d56dd507b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ac521693-c96c-49be-a9a7-5d56dd507b88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:21:32.769832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:21:32.771014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:21:32.771943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 589/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:21:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:21:32.779590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930a37b-5b93-4f7e-aaa1-201e6c9be844 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:32.833911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:32.876244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930a37b-5b93-4f7e-aaa1-201e6c9be844 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:32.908696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d02fa5-afd9-4bb3-a74a-055e4b3059d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:32.909952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d02fa5-afd9-4bb3-a74a-055e4b3059d2 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:32.910236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d02fa5-afd9-4bb3-a74a-055e4b3059d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:32.910540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d02fa5-afd9-4bb3-a74a-055e4b3059d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:32.911277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d02fa5-afd9-4bb3-a74a-055e4b3059d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:32.911584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d02fa5-afd9-4bb3-a74a-055e4b3059d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:32.912946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d02fa5-afd9-4bb3-a74a-055e4b3059d2 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:32.920994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 592/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:21:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:32.926835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac521693-c96c-49be-a9a7-5d56dd507b88 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:33.023041 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac521693-c96c-49be-a9a7-5d56dd507b88 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:33.055048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038df8-7c5e-4e39-adcb-2ab7e7ad2aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:33.055885 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038df8-7c5e-4e39-adcb-2ab7e7ad2aac None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:33.056161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038df8-7c5e-4e39-adcb-2ab7e7ad2aac None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:33.056429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038df8-7c5e-4e39-adcb-2ab7e7ad2aac None admin] PATH_INFO: `/v3/users/1a2b3b4b2bb04dd7906fc56595024b9a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:33.069334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04038df8-7c5e-4e39-adcb-2ab7e7ad2aac None admin] RBAC: Authorizing `identity:get_user(user_id=1a2b3b4b2bb04dd7906fc56595024b9a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:33.070789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04038df8-7c5e-4e39-adcb-2ab7e7ad2aac None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:33.072379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 590/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:21:32 2022] GET /identity/v3/users/1a2b3b4b2bb04dd7906fc56595024b9a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:33.077955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d02fa5-afd9-4bb3-a74a-055e4b3059d2 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:33.173297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d02fa5-afd9-4bb3-a74a-055e4b3059d2 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:33.189125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:33.206593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaea562-27d6-494c-a6f8-a1defef08a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:33.207218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaea562-27d6-494c-a6f8-a1defef08a79 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:33.207497 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaea562-27d6-494c-a6f8-a1defef08a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:33.207770 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaea562-27d6-494c-a6f8-a1defef08a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:33.271912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaea562-27d6-494c-a6f8-a1defef08a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:33.273388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaea562-27d6-494c-a6f8-a1defef08a79 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:33.369263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 593/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:21:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:21:33.375110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038df8-7c5e-4e39-adcb-2ab7e7ad2aac None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:33.403683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:33.476201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038df8-7c5e-4e39-adcb-2ab7e7ad2aac None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:33.509302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217a489-eea2-4e6a-af11-11b31258d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:33.510237 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217a489-eea2-4e6a-af11-11b31258d463 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:33.510559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217a489-eea2-4e6a-af11-11b31258d463 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:33.510833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217a489-eea2-4e6a-af11-11b31258d463 None admin] PATH_INFO: `/v3/projects/1d853a6d5b3e4f9a9447fea79f350b82` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:33.511990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217a489-eea2-4e6a-af11-11b31258d463 None admin] RBAC: Authorizing `identity:get_project(project_id=1d853a6d5b3e4f9a9447fea79f350b82)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:33.513412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217a489-eea2-4e6a-af11-11b31258d463 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:33.515127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 591/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:21:33 2022] GET /identity/v3/projects/1d853a6d5b3e4f9a9447fea79f350b82 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:33.521070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaea562-27d6-494c-a6f8-a1defef08a79 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:33.538771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:33.619997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaea562-27d6-494c-a6f8-a1defef08a79 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:33.655980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94fef3-7aa0-441a-9ddd-7ca91d6bae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:33.656628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94fef3-7aa0-441a-9ddd-7ca91d6bae4d None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:33.656913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94fef3-7aa0-441a-9ddd-7ca91d6bae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:33.657191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94fef3-7aa0-441a-9ddd-7ca91d6bae4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:33.658011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94fef3-7aa0-441a-9ddd-7ca91d6bae4d None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=1d853a6d5b3e4f9a9447fea79f350b82, user.id=1a2b3b4b2bb04dd7906fc56595024b9a) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:33.658325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94fef3-7aa0-441a-9ddd-7ca91d6bae4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:33.660422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94fef3-7aa0-441a-9ddd-7ca91d6bae4d None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:33.666875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 594/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:21:33 2022] GET /identity/v3/role_assignments?user.id=1a2b3b4b2bb04dd7906fc56595024b9a&scope.project.id=1d853a6d5b3e4f9a9447fea79f350b82&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:35.657765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e911585-2e3b-4e0c-af9f-c2cb429c03fe None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:35.658283 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e911585-2e3b-4e0c-af9f-c2cb429c03fe None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:35.658428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e911585-2e3b-4e0c-af9f-c2cb429c03fe None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:35.660344 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 592/1186] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:35.665477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789fb0c-19d6-4731-8253-4f7bb8521304 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:35.665916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789fb0c-19d6-4731-8253-4f7bb8521304 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:35.666009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789fb0c-19d6-4731-8253-4f7bb8521304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:35.682659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c789fb0c-19d6-4731-8253-4f7bb8521304 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:35.683823 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c789fb0c-19d6-4731-8253-4f7bb8521304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:35.748343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 595/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:35.770989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e911585-2e3b-4e0c-af9f-c2cb429c03fe None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:35.859055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:35.869634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e911585-2e3b-4e0c-af9f-c2cb429c03fe None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:35.901905 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b606d7-b496-4de5-9b9b-8fd3383f4824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:35.902703 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b606d7-b496-4de5-9b9b-8fd3383f4824 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:35.902995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b606d7-b496-4de5-9b9b-8fd3383f4824 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:35.903273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b606d7-b496-4de5-9b9b-8fd3383f4824 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:35.913538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b606d7-b496-4de5-9b9b-8fd3383f4824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-92b606d7-b496-4de5-9b9b-8fd3383f4824 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:21:35.921296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:21:35.922408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:35.923459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:21:35.926498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 593/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:21:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:21:35.928500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789fb0c-19d6-4731-8253-4f7bb8521304 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:35.942507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:36.025711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789fb0c-19d6-4731-8253-4f7bb8521304 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:36.057777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736654-28c0-4ca8-bdc6-7269c79afc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:36.058452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736654-28c0-4ca8-bdc6-7269c79afc82 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:36.058738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736654-28c0-4ca8-bdc6-7269c79afc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:36.059015 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52736654-28c0-4ca8-bdc6-7269c79afc82 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:36.059749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52736654-28c0-4ca8-bdc6-7269c79afc82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:36.060055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52736654-28c0-4ca8-bdc6-7269c79afc82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:36.061410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52736654-28c0-4ca8-bdc6-7269c79afc82 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:36.069697 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 596/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:21:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:36.075259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b606d7-b496-4de5-9b9b-8fd3383f4824 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:36.171644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b606d7-b496-4de5-9b9b-8fd3383f4824 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:36.207251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e54b7e-8e28-4663-b201-87445a0592cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:36.208142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e54b7e-8e28-4663-b201-87445a0592cc None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:36.208427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e54b7e-8e28-4663-b201-87445a0592cc None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:36.208704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e54b7e-8e28-4663-b201-87445a0592cc None admin] PATH_INFO: `/v3/users/1a2b3b4b2bb04dd7906fc56595024b9a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:36.209889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e54b7e-8e28-4663-b201-87445a0592cc None admin] RBAC: Authorizing `identity:get_user(user_id=1a2b3b4b2bb04dd7906fc56595024b9a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:36.211617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e54b7e-8e28-4663-b201-87445a0592cc None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:36.213882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 594/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:21:36 2022] GET /identity/v3/users/1a2b3b4b2bb04dd7906fc56595024b9a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:36.219485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736654-28c0-4ca8-bdc6-7269c79afc82 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:36.292665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:36.322780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52736654-28c0-4ca8-bdc6-7269c79afc82 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:36.359409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0ee67-61d4-40e2-aa64-b1cabd664fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:36.360771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ee67-61d4-40e2-aa64-b1cabd664fca None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:36.361244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ee67-61d4-40e2-aa64-b1cabd664fca None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:36.361744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ee67-61d4-40e2-aa64-b1cabd664fca None admin] PATH_INFO: `/v3/projects/1d853a6d5b3e4f9a9447fea79f350b82` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:36.363835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0ee67-61d4-40e2-aa64-b1cabd664fca None admin] RBAC: Authorizing `identity:get_project(project_id=1d853a6d5b3e4f9a9447fea79f350b82)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:36.365710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0ee67-61d4-40e2-aa64-b1cabd664fca None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:36.367467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 597/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:21:36 2022] GET /identity/v3/projects/1d853a6d5b3e4f9a9447fea79f350b82 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:36.373699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e54b7e-8e28-4663-b201-87445a0592cc None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:36.393520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:36.479589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e54b7e-8e28-4663-b201-87445a0592cc None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:36.517655 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317a1b9-858d-4395-9481-f9f53915ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:36.518582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317a1b9-858d-4395-9481-f9f53915ea9a None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:36.518867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317a1b9-858d-4395-9481-f9f53915ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:36.519140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317a1b9-858d-4395-9481-f9f53915ea9a None admin] PATH_INFO: `/v3/projects/1d853a6d5b3e4f9a9447fea79f350b82/users/1a2b3b4b2bb04dd7906fc56595024b9a/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:36.521074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317a1b9-858d-4395-9481-f9f53915ea9a None admin] RBAC: Authorizing `identity:create_grant(project_id=1d853a6d5b3e4f9a9447fea79f350b82, user_id=1a2b3b4b2bb04dd7906fc56595024b9a, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:36.522537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317a1b9-858d-4395-9481-f9f53915ea9a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:36.535500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 595/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:21:36 2022] PUT /identity/v3/projects/1d853a6d5b3e4f9a9447fea79f350b82/users/1a2b3b4b2bb04dd7906fc56595024b9a/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:21:38.535919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421550f-afe8-472f-a03d-a01b9e3a3750 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:38.536467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421550f-afe8-472f-a03d-a01b9e3a3750 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:38.536467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421550f-afe8-472f-a03d-a01b9e3a3750 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:38.537858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 598/1193] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:21:38.543036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ecdb8-2818-4fd2-858e-684ebcd3ba3c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:38.543449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ecdb8-2818-4fd2-858e-684ebcd3ba3c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:38.543603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ecdb8-2818-4fd2-858e-684ebcd3ba3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:38.560557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-519ecdb8-2818-4fd2-858e-684ebcd3ba3c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:21:38.561754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-519ecdb8-2818-4fd2-858e-684ebcd3ba3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:21:38.631333 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 596/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:21:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:21:38.655502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421550f-afe8-472f-a03d-a01b9e3a3750 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:38.754467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421550f-afe8-472f-a03d-a01b9e3a3750 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:38.787468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11cf9b-0320-466d-a79f-93ae3b85f1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:38.788186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cf9b-0320-466d-a79f-93ae3b85f1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:38.788471 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cf9b-0320-466d-a79f-93ae3b85f1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:38.788750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cf9b-0320-466d-a79f-93ae3b85f1e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:38.799413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11cf9b-0320-466d-a79f-93ae3b85f1e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-4e11cf9b-0320-466d-a79f-93ae3b85f1e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:21:38.806915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:21:38.807831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:21:38.808690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 599/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:21:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:21:38.813806 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ecdb8-2818-4fd2-858e-684ebcd3ba3c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:38.823671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:38.910185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ecdb8-2818-4fd2-858e-684ebcd3ba3c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:38.942475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3dd4b-0f01-4996-b86e-a35ce9e8d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:38.943128 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3dd4b-0f01-4996-b86e-a35ce9e8d2aa None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:38.943409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3dd4b-0f01-4996-b86e-a35ce9e8d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:38.943681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3dd4b-0f01-4996-b86e-a35ce9e8d2aa None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:38.944412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3dd4b-0f01-4996-b86e-a35ce9e8d2aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:38.944715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3dd4b-0f01-4996-b86e-a35ce9e8d2aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:38.946067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3dd4b-0f01-4996-b86e-a35ce9e8d2aa None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:38.953787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 597/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:21:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:38.959947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11cf9b-0320-466d-a79f-93ae3b85f1e9 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:38.962785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:39.057516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11cf9b-0320-466d-a79f-93ae3b85f1e9 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:39.090275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df6f4b-b764-4d4d-9ca5-d7e5b6eee5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:39.091154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df6f4b-b764-4d4d-9ca5-d7e5b6eee5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:39.091441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df6f4b-b764-4d4d-9ca5-d7e5b6eee5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:39.091717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df6f4b-b764-4d4d-9ca5-d7e5b6eee5c5 None admin] PATH_INFO: `/v3/users/1a2b3b4b2bb04dd7906fc56595024b9a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:39.092875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df6f4b-b764-4d4d-9ca5-d7e5b6eee5c5 None admin] RBAC: Authorizing `identity:get_user(user_id=1a2b3b4b2bb04dd7906fc56595024b9a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:39.094282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df6f4b-b764-4d4d-9ca5-d7e5b6eee5c5 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:39.095899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 600/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Jun 24 10:21:38 2022] GET /identity/v3/users/1a2b3b4b2bb04dd7906fc56595024b9a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:39.101430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3dd4b-0f01-4996-b86e-a35ce9e8d2aa None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:39.167805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:39.199224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3dd4b-0f01-4996-b86e-a35ce9e8d2aa None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:39.231221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aaeb0-993c-46a0-8028-65c8f7725ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:39.231844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aaeb0-993c-46a0-8028-65c8f7725ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:39.232124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aaeb0-993c-46a0-8028-65c8f7725ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:39.232396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aaeb0-993c-46a0-8028-65c8f7725ce2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:39.296498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2aaeb0-993c-46a0-8028-65c8f7725ce2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:39.297953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2aaeb0-993c-46a0-8028-65c8f7725ce2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:39.362526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:39.394021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 598/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:21:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:21:39.399961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df6f4b-b764-4d4d-9ca5-d7e5b6eee5c5 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:39.466773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:39.497530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df6f4b-b764-4d4d-9ca5-d7e5b6eee5c5 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:39.530108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987f9d9-ee7a-449f-b569-527104527159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:39.530968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987f9d9-ee7a-449f-b569-527104527159 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:39.531253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987f9d9-ee7a-449f-b569-527104527159 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:39.531526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987f9d9-ee7a-449f-b569-527104527159 None admin] PATH_INFO: `/v3/projects/1d853a6d5b3e4f9a9447fea79f350b82` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:39.532682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987f9d9-ee7a-449f-b569-527104527159 None admin] RBAC: Authorizing `identity:get_project(project_id=1d853a6d5b3e4f9a9447fea79f350b82)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:39.534764 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987f9d9-ee7a-449f-b569-527104527159 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:39.536427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 601/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Jun 24 10:21:39 2022] GET /identity/v3/projects/1d853a6d5b3e4f9a9447fea79f350b82 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:39.542279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aaeb0-993c-46a0-8028-65c8f7725ce2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:21:39.644399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aaeb0-993c-46a0-8028-65c8f7725ce2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:21:39.680633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b814670-5efa-4df6-af62-8321386879f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:21:39.681294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b814670-5efa-4df6-af62-8321386879f8 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:21:39.681581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b814670-5efa-4df6-af62-8321386879f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:21:39.681861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b814670-5efa-4df6-af62-8321386879f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:21:39.682727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b814670-5efa-4df6-af62-8321386879f8 None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=1d853a6d5b3e4f9a9447fea79f350b82, user.id=1a2b3b4b2bb04dd7906fc56595024b9a) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:21:39.683043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b814670-5efa-4df6-af62-8321386879f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:21:39.684476 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b814670-5efa-4df6-af62-8321386879f8 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:21:39.690222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 599/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:21:39 2022] GET /identity/v3/role_assignments?user.id=1a2b3b4b2bb04dd7906fc56595024b9a&scope.project.id=1d853a6d5b3e4f9a9447fea79f350b82&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:21:49.526152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=31 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:49.687633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=83 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:34.455459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618c95-b073-4c8e-a7a8-128b7021a682 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:34.456201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618c95-b073-4c8e-a7a8-128b7021a682 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:34.456201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72618c95-b073-4c8e-a7a8-128b7021a682 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:34.457576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 602/1201] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:22:34.463362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc6bde-9391-461d-988c-38623d78e7e0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:34.463836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc6bde-9391-461d-988c-38623d78e7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:34.464012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc6bde-9391-461d-988c-38623d78e7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:34.484499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-00dc6bde-9391-461d-988c-38623d78e7e0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:22:34.485892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-00dc6bde-9391-461d-988c-38623d78e7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:22:34.576356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 600/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:22:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:22:34.603489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72618c95-b073-4c8e-a7a8-128b7021a682 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:34.740720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72618c95-b073-4c8e-a7a8-128b7021a682 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:34.783599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb72b-ba2c-414c-9f17-9406082e6b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:34.784463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb72b-ba2c-414c-9f17-9406082e6b68 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:34.784821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb72b-ba2c-414c-9f17-9406082e6b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:34.785100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb72b-ba2c-414c-9f17-9406082e6b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:34.798989 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fb72b-ba2c-414c-9f17-9406082e6b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:34.803157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fb72b-ba2c-414c-9f17-9406082e6b68 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-168fb72b-ba2c-414c-9f17-9406082e6b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:34.826654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:34.828031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:34.829559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:34.829559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:34.829559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:34.829559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:34.829559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 603/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:34.834693 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc6bde-9391-461d-988c-38623d78e7e0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:34.970334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc6bde-9391-461d-988c-38623d78e7e0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:35.008945 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:35.019981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cfcad-4018-4afe-848b-ca7fac564235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:35.020731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cfcad-4018-4afe-848b-ca7fac564235 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:35.021069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cfcad-4018-4afe-848b-ca7fac564235 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:35.021356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cfcad-4018-4afe-848b-ca7fac564235 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:35.022168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cfcad-4018-4afe-848b-ca7fac564235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:35.022514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cfcad-4018-4afe-848b-ca7fac564235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:35.023934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cfcad-4018-4afe-848b-ca7fac564235 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:35.038433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 601/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:35.044161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb72b-ba2c-414c-9f17-9406082e6b68 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:35.119795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:35.180566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb72b-ba2c-414c-9f17-9406082e6b68 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:35.223606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c54967-f429-4c6d-8227-7f098550d49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:35.224371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c54967-f429-4c6d-8227-7f098550d49a None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:35.224659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c54967-f429-4c6d-8227-7f098550d49a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:35.224936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c54967-f429-4c6d-8227-7f098550d49a None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:35.225678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c54967-f429-4c6d-8227-7f098550d49a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:35.227147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c54967-f429-4c6d-8227-7f098550d49a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:35.251472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 604/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Jun 24 10:22:35 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:22:37.580332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a48c9-eb17-45f0-b580-3fd4281839c9 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:37.580764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a48c9-eb17-45f0-b580-3fd4281839c9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:37.580902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a48c9-eb17-45f0-b580-3fd4281839c9 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:37.582512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 602/1206] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:22:37.588997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8295d5f-2252-4635-882e-b0414fb656cb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:37.589538 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8295d5f-2252-4635-882e-b0414fb656cb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:37.589538 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8295d5f-2252-4635-882e-b0414fb656cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:37.614823 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f8295d5f-2252-4635-882e-b0414fb656cb None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:22:37.617088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f8295d5f-2252-4635-882e-b0414fb656cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:22:37.704556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 605/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:22:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:22:37.731291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a48c9-eb17-45f0-b580-3fd4281839c9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:37.871592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a48c9-eb17-45f0-b580-3fd4281839c9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:37.913297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b65ac2-1d41-4b7a-b3a9-4a66bb6255c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:37.914542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b65ac2-1d41-4b7a-b3a9-4a66bb6255c2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:37.914894 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b65ac2-1d41-4b7a-b3a9-4a66bb6255c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:37.915110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b65ac2-1d41-4b7a-b3a9-4a66bb6255c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:37.927609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b65ac2-1d41-4b7a-b3a9-4a66bb6255c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c0b65ac2-1d41-4b7a-b3a9-4a66bb6255c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:22:37.935776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:37.937038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:37.942943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 603/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:22:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:37.945612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8295d5f-2252-4635-882e-b0414fb656cb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:38.002532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:38.083322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8295d5f-2252-4635-882e-b0414fb656cb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:38.122763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d13492-0f59-485a-b9c4-ab30ccd92b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:38.123654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d13492-0f59-485a-b9c4-ab30ccd92b24 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:38.123920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d13492-0f59-485a-b9c4-ab30ccd92b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:38.124328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d13492-0f59-485a-b9c4-ab30ccd92b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:38.125235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d13492-0f59-485a-b9c4-ab30ccd92b24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:38.125662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d13492-0f59-485a-b9c4-ab30ccd92b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:38.127266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d13492-0f59-485a-b9c4-ab30ccd92b24 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:38.136799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 606/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:22:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:38.144899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b65ac2-1d41-4b7a-b3a9-4a66bb6255c2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:38.209349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:38.270455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b65ac2-1d41-4b7a-b3a9-4a66bb6255c2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:38.309030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce7380-737b-4c57-ac85-fdf9ef58fedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:38.309832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7380-737b-4c57-ac85-fdf9ef58fedd None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:38.310527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7380-737b-4c57-ac85-fdf9ef58fedd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:38.310527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7380-737b-4c57-ac85-fdf9ef58fedd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:38.322754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce7380-737b-4c57-ac85-fdf9ef58fedd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:38.324865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce7380-737b-4c57-ac85-fdf9ef58fedd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-50ce7380-737b-4c57-ac85-fdf9ef58fedd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:38.345322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:38.346386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:38.347354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:38.347354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:38.347354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:38.347354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:38.350548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 604/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:38.352529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d13492-0f59-485a-b9c4-ab30ccd92b24 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:38.471988 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:38.474225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d13492-0f59-485a-b9c4-ab30ccd92b24 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:38.511888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f84368-10dc-4358-baaa-193c6b139bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:38.512553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f84368-10dc-4358-baaa-193c6b139bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:38.512973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f84368-10dc-4358-baaa-193c6b139bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:38.513149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f84368-10dc-4358-baaa-193c6b139bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:38.514389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f84368-10dc-4358-baaa-193c6b139bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:38.514389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f84368-10dc-4358-baaa-193c6b139bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:38.515644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f84368-10dc-4358-baaa-193c6b139bd6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:38.528646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 607/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:38.536341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce7380-737b-4c57-ac85-fdf9ef58fedd None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:38.656667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce7380-737b-4c57-ac85-fdf9ef58fedd None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:38.658365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:38.696372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38becd4b-54e4-426a-80fc-bb7384f52808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:38.697491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38becd4b-54e4-426a-80fc-bb7384f52808 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:38.697844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38becd4b-54e4-426a-80fc-bb7384f52808 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:38.698185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38becd4b-54e4-426a-80fc-bb7384f52808 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:38.706827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38becd4b-54e4-426a-80fc-bb7384f52808 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:38.708538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38becd4b-54e4-426a-80fc-bb7384f52808 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-38becd4b-54e4-426a-80fc-bb7384f52808 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:22:38.728653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:38.729887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:38.731116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:38.731116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:38.731116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:22:38.731116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:22:38.731116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:22:38.731116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:22:38.731116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:22:38.731116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:22:38.731116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:22:38.731116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:38.735021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 605/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:22:38.736364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f84368-10dc-4358-baaa-193c6b139bd6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:38.853424 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f84368-10dc-4358-baaa-193c6b139bd6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:38.892106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743acc3-90a3-4018-81bd-7941c5366487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:38.893072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743acc3-90a3-4018-81bd-7941c5366487 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:38.893528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743acc3-90a3-4018-81bd-7941c5366487 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:38.896204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743acc3-90a3-4018-81bd-7941c5366487 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:38.896204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743acc3-90a3-4018-81bd-7941c5366487 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:38.896204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743acc3-90a3-4018-81bd-7941c5366487 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:38.896501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743acc3-90a3-4018-81bd-7941c5366487 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:38.918427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 608/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Jun 24 10:22:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:38.922692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38becd4b-54e4-426a-80fc-bb7384f52808 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:39.045181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38becd4b-54e4-426a-80fc-bb7384f52808 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:39.088700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2d0d-5c61-4837-b725-dfe91de86265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:39.089651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2d0d-5c61-4837-b725-dfe91de86265 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:39.089940 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2d0d-5c61-4837-b725-dfe91de86265 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:39.090240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2d0d-5c61-4837-b725-dfe91de86265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:39.124704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:39.175134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b2d0d-5c61-4837-b725-dfe91de86265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:39.176701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b2d0d-5c61-4837-b725-dfe91de86265 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:39.290748 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 606/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:22:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:22:39.297385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743acc3-90a3-4018-81bd-7941c5366487 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:39.318083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:39.409392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743acc3-90a3-4018-81bd-7941c5366487 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:39.444915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6f8e3-fdf7-47f1-ae9b-57e9fc6833b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:39.445812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6f8e3-fdf7-47f1-ae9b-57e9fc6833b6 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:39.446142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6f8e3-fdf7-47f1-ae9b-57e9fc6833b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:39.446397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6f8e3-fdf7-47f1-ae9b-57e9fc6833b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:39.458140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6f8e3-fdf7-47f1-ae9b-57e9fc6833b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:39.459669 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6f8e3-fdf7-47f1-ae9b-57e9fc6833b6 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-24f6f8e3-fdf7-47f1-ae9b-57e9fc6833b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:39.478508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:39.479676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:39.485379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:39.485379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:39.485379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:39.485379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:39.485379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 609/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:39.485761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2d0d-5c61-4837-b725-dfe91de86265 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:39.563120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:39.614677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2d0d-5c61-4837-b725-dfe91de86265 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:39.652963 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569492b-8bec-4c6d-95ec-ea9c9584157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:39.653757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569492b-8bec-4c6d-95ec-ea9c9584157a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:39.654114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569492b-8bec-4c6d-95ec-ea9c9584157a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:39.654493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569492b-8bec-4c6d-95ec-ea9c9584157a None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:39.655846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569492b-8bec-4c6d-95ec-ea9c9584157a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:39.656227 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569492b-8bec-4c6d-95ec-ea9c9584157a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:39.657700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569492b-8bec-4c6d-95ec-ea9c9584157a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:39.670297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 607/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:39.676673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6f8e3-fdf7-47f1-ae9b-57e9fc6833b6 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:39.757849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:39.792920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6f8e3-fdf7-47f1-ae9b-57e9fc6833b6 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:39.831510 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f4a84-4de5-4c9d-b262-7d95655659af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:39.832256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f4a84-4de5-4c9d-b262-7d95655659af None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:39.832544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f4a84-4de5-4c9d-b262-7d95655659af None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:39.832823 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f4a84-4de5-4c9d-b262-7d95655659af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:39.839721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f4a84-4de5-4c9d-b262-7d95655659af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:39.841168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f4a84-4de5-4c9d-b262-7d95655659af None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-010f4a84-4de5-4c9d-b262-7d95655659af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:22:39.854896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:39.856124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:39.859594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:22:39.859594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:22:39.859594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:22:39.859594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:22:39.859594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:22:39.859594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:22:39.859594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:22:39.859594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:39.859594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 610/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:22:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:22:39.863488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569492b-8bec-4c6d-95ec-ea9c9584157a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:39.970649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569492b-8bec-4c6d-95ec-ea9c9584157a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:40.000356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:40.013834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185169d-fd3f-4c6a-abe5-15e3c043df04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:40.014625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185169d-fd3f-4c6a-abe5-15e3c043df04 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:40.014964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185169d-fd3f-4c6a-abe5-15e3c043df04 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:40.015196 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185169d-fd3f-4c6a-abe5-15e3c043df04 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:40.015987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185169d-fd3f-4c6a-abe5-15e3c043df04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:40.016303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185169d-fd3f-4c6a-abe5-15e3c043df04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:40.017762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185169d-fd3f-4c6a-abe5-15e3c043df04 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:40.032425 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 608/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:22:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:40.040405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f4a84-4de5-4c9d-b262-7d95655659af None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:40.160541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f4a84-4de5-4c9d-b262-7d95655659af None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:40.194381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:40.203187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3a237-9cea-46ee-9318-3e12605763ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:40.204125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a237-9cea-46ee-9318-3e12605763ca None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:40.204358 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a237-9cea-46ee-9318-3e12605763ca None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:40.204638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a237-9cea-46ee-9318-3e12605763ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:40.205618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3a237-9cea-46ee-9318-3e12605763ca None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=06d6f1eebcfa48349613455eb5d2aaf0) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:40.205950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3a237-9cea-46ee-9318-3e12605763ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:40.207417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3a237-9cea-46ee-9318-3e12605763ca None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:40.214770 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 611/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:22:40 2022] GET /identity/v3/role_assignments?user.id=06d6f1eebcfa48349613455eb5d2aaf0&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:42.276871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5d91-dc82-4167-8ec3-618f32ac22cb None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:42.277405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5d91-dc82-4167-8ec3-618f32ac22cb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:42.277525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5d91-dc82-4167-8ec3-618f32ac22cb None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:42.278871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 609/1220] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:22:42.284181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0b74-7e95-45b2-84a6-1cedfa1da525 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:42.284601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0b74-7e95-45b2-84a6-1cedfa1da525 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:42.284736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0b74-7e95-45b2-84a6-1cedfa1da525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:42.302909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e2bd0b74-7e95-45b2-84a6-1cedfa1da525 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:22:42.305063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e2bd0b74-7e95-45b2-84a6-1cedfa1da525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:22:42.386260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 612/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:22:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 10:22:42.414960 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a5d91-dc82-4167-8ec3-618f32ac22cb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:42.532941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a5d91-dc82-4167-8ec3-618f32ac22cb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:42.569690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35287bc-e012-4d11-a834-3f254047bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:42.570603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35287bc-e012-4d11-a834-3f254047bf43 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:42.570897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35287bc-e012-4d11-a834-3f254047bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:42.571168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35287bc-e012-4d11-a834-3f254047bf43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:42.583038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35287bc-e012-4d11-a834-3f254047bf43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-f35287bc-e012-4d11-a834-3f254047bf43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:22:42.591316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:42.593127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:42.594286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 610/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:22:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:22:42.599708 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0b74-7e95-45b2-84a6-1cedfa1da525 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:42.708906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0b74-7e95-45b2-84a6-1cedfa1da525 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:42.732167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:42.743631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9934e26-df21-4498-8f40-935b2ba7d271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:42.744320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934e26-df21-4498-8f40-935b2ba7d271 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:42.744627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934e26-df21-4498-8f40-935b2ba7d271 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:42.744926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934e26-df21-4498-8f40-935b2ba7d271 None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:42.745729 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9934e26-df21-4498-8f40-935b2ba7d271 None admin] RBAC: Adding query filter params (name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:42.746042 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9934e26-df21-4498-8f40-935b2ba7d271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:42.747605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9934e26-df21-4498-8f40-935b2ba7d271 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:42.762726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 613/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:22:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:42.766099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35287bc-e012-4d11-a834-3f254047bf43 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:42.811855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:42.883258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35287bc-e012-4d11-a834-3f254047bf43 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:42.927353 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a429d-d1f6-42fd-9998-26070ebed58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:42.928103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a429d-d1f6-42fd-9998-26070ebed58c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:42.928396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a429d-d1f6-42fd-9998-26070ebed58c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:42.928672 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a429d-d1f6-42fd-9998-26070ebed58c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:42.940288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a429d-d1f6-42fd-9998-26070ebed58c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:42.941747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a429d-d1f6-42fd-9998-26070ebed58c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-eb6a429d-d1f6-42fd-9998-26070ebed58c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:42.959225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:42.960330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:42.961430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:42.961430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:42.961430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:42.961430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:42.961430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 611/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:42.966274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9934e26-df21-4498-8f40-935b2ba7d271 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:43.076136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9934e26-df21-4498-8f40-935b2ba7d271 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:43.111773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966aad0-4f9b-49a6-aee7-41f5c7b663c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:43.112438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966aad0-4f9b-49a6-aee7-41f5c7b663c4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:43.112721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966aad0-4f9b-49a6-aee7-41f5c7b663c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:43.113001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966aad0-4f9b-49a6-aee7-41f5c7b663c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:43.113716 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966aad0-4f9b-49a6-aee7-41f5c7b663c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:43.114022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966aad0-4f9b-49a6-aee7-41f5c7b663c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:43.115419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966aad0-4f9b-49a6-aee7-41f5c7b663c4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:43.132651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 614/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:43.133849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a429d-d1f6-42fd-9998-26070ebed58c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:43.240047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:43.247300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a429d-d1f6-42fd-9998-26070ebed58c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:43.283845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b738f-dc04-4ea7-85c5-71f34252aed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:43.284686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b738f-dc04-4ea7-85c5-71f34252aed2 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:43.284979 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b738f-dc04-4ea7-85c5-71f34252aed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:43.285355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b738f-dc04-4ea7-85c5-71f34252aed2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:43.293452 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b738f-dc04-4ea7-85c5-71f34252aed2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:43.294933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b738f-dc04-4ea7-85c5-71f34252aed2 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-a35b738f-dc04-4ea7-85c5-71f34252aed2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:22:43.310468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:43.312899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:43.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 612/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:43.319362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966aad0-4f9b-49a6-aee7-41f5c7b663c4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:43.376024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:43.436532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966aad0-4f9b-49a6-aee7-41f5c7b663c4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:43.474006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1358dd1-90fa-4bdb-aa9e-e478c828b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:43.474742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358dd1-90fa-4bdb-aa9e-e478c828b203 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:43.475036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358dd1-90fa-4bdb-aa9e-e478c828b203 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:43.475319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358dd1-90fa-4bdb-aa9e-e478c828b203 None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:43.476275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1358dd1-90fa-4bdb-aa9e-e478c828b203 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:43.476596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1358dd1-90fa-4bdb-aa9e-e478c828b203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:43.478063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1358dd1-90fa-4bdb-aa9e-e478c828b203 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:43.497717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 615/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Jun 24 10:22:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:22:43.503454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b738f-dc04-4ea7-85c5-71f34252aed2 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:43.621486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b738f-dc04-4ea7-85c5-71f34252aed2 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:43.657262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0e96a-cae1-466d-abe4-039fef57e996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:43.658063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0e96a-cae1-466d-abe4-039fef57e996 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:43.658394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0e96a-cae1-466d-abe4-039fef57e996 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:43.658742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0e96a-cae1-466d-abe4-039fef57e996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:43.671189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0e96a-cae1-466d-abe4-039fef57e996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:43.672643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0e96a-cae1-466d-abe4-039fef57e996 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-11f0e96a-cae1-466d-abe4-039fef57e996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:43.689488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:43.690551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:43.691528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:43.691528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:43.691528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:43.691528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:43.691528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 613/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:43.696691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1358dd1-90fa-4bdb-aa9e-e478c828b203 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:43.804876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1358dd1-90fa-4bdb-aa9e-e478c828b203 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:43.807610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:43.843345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fa9ab-4d43-4225-895f-58f09558b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:43.844129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fa9ab-4d43-4225-895f-58f09558b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:43.844411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fa9ab-4d43-4225-895f-58f09558b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:43.844680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fa9ab-4d43-4225-895f-58f09558b0b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:43.845485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fa9ab-4d43-4225-895f-58f09558b0b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:43.845787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fa9ab-4d43-4225-895f-58f09558b0b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:43.847354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fa9ab-4d43-4225-895f-58f09558b0b4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:43.860214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 616/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:43.866562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0e96a-cae1-466d-abe4-039fef57e996 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:43.877107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:43.977937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0e96a-cae1-466d-abe4-039fef57e996 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:44.018514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330984fe-f675-433e-a994-78ffbbf5699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:44.019344 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330984fe-f675-433e-a994-78ffbbf5699c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:44.019717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330984fe-f675-433e-a994-78ffbbf5699c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:44.019869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330984fe-f675-433e-a994-78ffbbf5699c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:44.026614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330984fe-f675-433e-a994-78ffbbf5699c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:44.028063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330984fe-f675-433e-a994-78ffbbf5699c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-330984fe-f675-433e-a994-78ffbbf5699c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:22:44.046291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:44.047859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:44.049059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:22:44.049059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:22:44.049059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:22:44.049059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:22:44.049059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:22:44.049059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:22:44.049059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:22:44.049059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:44.049059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 614/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:22:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:22:44.054113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fa9ab-4d43-4225-895f-58f09558b0b4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:44.159662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fa9ab-4d43-4225-895f-58f09558b0b4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:44.195259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301581d-a39c-4960-96c8-4d86aeb490ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:44.195924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301581d-a39c-4960-96c8-4d86aeb490ea None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:44.196211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301581d-a39c-4960-96c8-4d86aeb490ea None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:44.196486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301581d-a39c-4960-96c8-4d86aeb490ea None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:44.197271 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301581d-a39c-4960-96c8-4d86aeb490ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:44.197589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301581d-a39c-4960-96c8-4d86aeb490ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:44.199052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301581d-a39c-4960-96c8-4d86aeb490ea None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:44.212521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 617/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:22:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:22:44.218679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330984fe-f675-433e-a994-78ffbbf5699c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:44.292801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:44.334258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330984fe-f675-433e-a994-78ffbbf5699c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:44.372932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b9920-3e17-4285-a021-dc6c37c86c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:44.374462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b9920-3e17-4285-a021-dc6c37c86c73 None admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:44.374752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b9920-3e17-4285-a021-dc6c37c86c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:44.375052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b9920-3e17-4285-a021-dc6c37c86c73 None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/06d6f1eebcfa48349613455eb5d2aaf0/roles/d26d3b3eb78246ffb76d8ad95123c66c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:44.390943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b9920-3e17-4285-a021-dc6c37c86c73 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=06d6f1eebcfa48349613455eb5d2aaf0, role_id=d26d3b3eb78246ffb76d8ad95123c66c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:44.392602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b9920-3e17-4285-a021-dc6c37c86c73 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:44.404868 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 615/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:22:44 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/06d6f1eebcfa48349613455eb5d2aaf0/roles/d26d3b3eb78246ffb76d8ad95123c66c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:22:46.532024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c0573-3668-490d-9135-f7c109e20f84 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:46.532553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c0573-3668-490d-9135-f7c109e20f84 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:46.532678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c0573-3668-490d-9135-f7c109e20f84 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:46.533951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 618/1233] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:22:46.539188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa26aa-004c-43b5-b6f5-e30d681b1a21 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:46.539589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa26aa-004c-43b5-b6f5-e30d681b1a21 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:46.539738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa26aa-004c-43b5-b6f5-e30d681b1a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:46.557838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-03fa26aa-004c-43b5-b6f5-e30d681b1a21 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:22:46.559064 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-03fa26aa-004c-43b5-b6f5-e30d681b1a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:22:46.632621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 616/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:22:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:22:46.657818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c0573-3668-490d-9135-f7c109e20f84 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:46.685109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:46.769116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c0573-3668-490d-9135-f7c109e20f84 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:46.808137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c8d09-0b5b-4d06-bcf5-8ddf1efd4d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:46.808908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c8d09-0b5b-4d06-bcf5-8ddf1efd4d87 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:46.809159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c8d09-0b5b-4d06-bcf5-8ddf1efd4d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:46.809418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c8d09-0b5b-4d06-bcf5-8ddf1efd4d87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:46.820559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c8d09-0b5b-4d06-bcf5-8ddf1efd4d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-7f7c8d09-0b5b-4d06-bcf5-8ddf1efd4d87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:22:46.828228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:46.829405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:46.830968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 619/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Jun 24 10:22:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:46.835937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa26aa-004c-43b5-b6f5-e30d681b1a21 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:46.892199 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:46.948768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa26aa-004c-43b5-b6f5-e30d681b1a21 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:46.983988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62509e5-16f2-4c42-b7d8-8f22dd2bd8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:46.984689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62509e5-16f2-4c42-b7d8-8f22dd2bd8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:46.984973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62509e5-16f2-4c42-b7d8-8f22dd2bd8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:46.985246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62509e5-16f2-4c42-b7d8-8f22dd2bd8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:46.985987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62509e5-16f2-4c42-b7d8-8f22dd2bd8b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:46.986294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62509e5-16f2-4c42-b7d8-8f22dd2bd8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:46.987679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62509e5-16f2-4c42-b7d8-8f22dd2bd8b4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:46.996927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 617/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Jun 24 10:22:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:47.003644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c8d09-0b5b-4d06-bcf5-8ddf1efd4d87 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:47.097422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:47.116088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c8d09-0b5b-4d06-bcf5-8ddf1efd4d87 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:47.155101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc833b-2710-45b8-9c3e-d176eb47affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:47.155893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc833b-2710-45b8-9c3e-d176eb47affc None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:47.156177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc833b-2710-45b8-9c3e-d176eb47affc None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:47.156473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc833b-2710-45b8-9c3e-d176eb47affc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:47.168988 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc833b-2710-45b8-9c3e-d176eb47affc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:47.170954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc833b-2710-45b8-9c3e-d176eb47affc None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-adfc833b-2710-45b8-9c3e-d176eb47affc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:47.192385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:47.193516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:47.194582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:47.194582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:47.194582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:47.194582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:47.194582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 620/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:47.199526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62509e5-16f2-4c42-b7d8-8f22dd2bd8b4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:47.311787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62509e5-16f2-4c42-b7d8-8f22dd2bd8b4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:47.323217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:47.353439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1b874-4fee-4dd8-9775-0c806103dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:47.354129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1b874-4fee-4dd8-9775-0c806103dd21 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:47.354389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1b874-4fee-4dd8-9775-0c806103dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:47.354857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1b874-4fee-4dd8-9775-0c806103dd21 None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:47.355613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1b874-4fee-4dd8-9775-0c806103dd21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:47.355984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1b874-4fee-4dd8-9775-0c806103dd21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:47.357592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1b874-4fee-4dd8-9775-0c806103dd21 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:47.372112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 618/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:47.378989 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc833b-2710-45b8-9c3e-d176eb47affc None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:47.488200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc833b-2710-45b8-9c3e-d176eb47affc None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:47.525452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9c7ea-f585-4f02-ae71-f3b7c6a8a312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:47.526282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9c7ea-f585-4f02-ae71-f3b7c6a8a312 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:47.526595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9c7ea-f585-4f02-ae71-f3b7c6a8a312 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:47.526869 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9c7ea-f585-4f02-ae71-f3b7c6a8a312 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:47.530209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:47.537121 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9c7ea-f585-4f02-ae71-f3b7c6a8a312 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:47.538562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9c7ea-f585-4f02-ae71-f3b7c6a8a312 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-abe9c7ea-f585-4f02-ae71-f3b7c6a8a312 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:22:47.554884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:47.556374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:47.557502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 621/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:47.563466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1b874-4fee-4dd8-9775-0c806103dd21 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:47.675347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1b874-4fee-4dd8-9775-0c806103dd21 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:47.712687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af528eb9-fbab-42b8-9954-f285813d1e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:47.713368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af528eb9-fbab-42b8-9954-f285813d1e38 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:47.713656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af528eb9-fbab-42b8-9954-f285813d1e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:47.713935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af528eb9-fbab-42b8-9954-f285813d1e38 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:47.714876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af528eb9-fbab-42b8-9954-f285813d1e38 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:47.715187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af528eb9-fbab-42b8-9954-f285813d1e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:47.716804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af528eb9-fbab-42b8-9954-f285813d1e38 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:47.736610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 619/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Jun 24 10:22:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:47.742538 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9c7ea-f585-4f02-ae71-f3b7c6a8a312 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:47.850609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9c7ea-f585-4f02-ae71-f3b7c6a8a312 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:47.886955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d8041-0d1c-4092-b844-de8a6a0b8e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:47.887601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d8041-0d1c-4092-b844-de8a6a0b8e10 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:47.887978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d8041-0d1c-4092-b844-de8a6a0b8e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:47.888208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d8041-0d1c-4092-b844-de8a6a0b8e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:47.959430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:47.967471 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d8041-0d1c-4092-b844-de8a6a0b8e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:47.969124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d8041-0d1c-4092-b844-de8a6a0b8e10 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:48.081945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 622/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:22:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:22:48.089235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af528eb9-fbab-42b8-9954-f285813d1e38 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:48.119343 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:48.210715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af528eb9-fbab-42b8-9954-f285813d1e38 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:48.253485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453bc3e-fa32-44df-86c0-d4c70f105b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:48.254283 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453bc3e-fa32-44df-86c0-d4c70f105b77 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:48.254662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453bc3e-fa32-44df-86c0-d4c70f105b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:48.254862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453bc3e-fa32-44df-86c0-d4c70f105b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:48.265606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453bc3e-fa32-44df-86c0-d4c70f105b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:48.267114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453bc3e-fa32-44df-86c0-d4c70f105b77 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-c453bc3e-fa32-44df-86c0-d4c70f105b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:48.285066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:48.286215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:48.287518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:48.287518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:48.287518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:48.287518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:48.287518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 620/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:22:48.292439 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d8041-0d1c-4092-b844-de8a6a0b8e10 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:48.400640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:48.408619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d8041-0d1c-4092-b844-de8a6a0b8e10 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:48.444221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1620d38-145a-44ee-a6d3-55846f841535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:48.445001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1620d38-145a-44ee-a6d3-55846f841535 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:48.445302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1620d38-145a-44ee-a6d3-55846f841535 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:48.445576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1620d38-145a-44ee-a6d3-55846f841535 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:48.446425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1620d38-145a-44ee-a6d3-55846f841535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:48.446748 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1620d38-145a-44ee-a6d3-55846f841535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:48.448203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1620d38-145a-44ee-a6d3-55846f841535 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:48.461384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 623/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:48.468168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453bc3e-fa32-44df-86c0-d4c70f105b77 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:48.559312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:48.588341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453bc3e-fa32-44df-86c0-d4c70f105b77 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:48.626067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272a0ad-a63b-4095-b360-4401ceb969fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:48.626067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a0ad-a63b-4095-b360-4401ceb969fd None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:48.626447 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a0ad-a63b-4095-b360-4401ceb969fd None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:48.626656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a0ad-a63b-4095-b360-4401ceb969fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:48.634146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272a0ad-a63b-4095-b360-4401ceb969fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:48.635786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272a0ad-a63b-4095-b360-4401ceb969fd None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-3272a0ad-a63b-4095-b360-4401ceb969fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:22:48.652160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:48.653345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:48.655048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:22:48.655048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:22:48.655048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:22:48.655048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:22:48.655048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:22:48.655048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:22:48.655048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:22:48.655048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:48.655048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 621/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:48.660399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1620d38-145a-44ee-a6d3-55846f841535 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:48.774924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1620d38-145a-44ee-a6d3-55846f841535 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:48.815436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528cc46-d72a-4f29-a72b-3012dc48f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:48.816256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528cc46-d72a-4f29-a72b-3012dc48f2fa None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:48.816504 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528cc46-d72a-4f29-a72b-3012dc48f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:48.816839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528cc46-d72a-4f29-a72b-3012dc48f2fa None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:48.817777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528cc46-d72a-4f29-a72b-3012dc48f2fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:48.818139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528cc46-d72a-4f29-a72b-3012dc48f2fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:48.819934 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528cc46-d72a-4f29-a72b-3012dc48f2fa None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:48.834844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 624/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:22:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:48.840961 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272a0ad-a63b-4095-b360-4401ceb969fd None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:48.948490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272a0ad-a63b-4095-b360-4401ceb969fd None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:48.985909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02ef6-1dda-4801-a292-9edcbdf2aad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:48.987847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02ef6-1dda-4801-a292-9edcbdf2aad5 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:48.987847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02ef6-1dda-4801-a292-9edcbdf2aad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:48.987847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02ef6-1dda-4801-a292-9edcbdf2aad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:48.988190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02ef6-1dda-4801-a292-9edcbdf2aad5 None admin] RBAC: Adding query filter params (role.id=d26d3b3eb78246ffb76d8ad95123c66c, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=06d6f1eebcfa48349613455eb5d2aaf0) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:48.988365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02ef6-1dda-4801-a292-9edcbdf2aad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:48.989970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02ef6-1dda-4801-a292-9edcbdf2aad5 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:48.996684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 622/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:22:48 2022] GET /identity/v3/role_assignments?user.id=06d6f1eebcfa48349613455eb5d2aaf0&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=d26d3b3eb78246ffb76d8ad95123c66c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:51.147786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7f66f-5db8-4475-bd79-e38991102472 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:51.148345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7f66f-5db8-4475-bd79-e38991102472 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:51.148345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7f66f-5db8-4475-bd79-e38991102472 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:51.149728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 625/1247] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:22:51.155286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f40e62-5464-4c5a-b70d-dda079159ebf None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:51.155708 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f40e62-5464-4c5a-b70d-dda079159ebf None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:51.155848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f40e62-5464-4c5a-b70d-dda079159ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:51.160880 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:51.175354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e5f40e62-5464-4c5a-b70d-dda079159ebf None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:22:51.176744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e5f40e62-5464-4c5a-b70d-dda079159ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:22:51.253900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 623/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:22:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:22:51.278686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7f66f-5db8-4475-bd79-e38991102472 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:51.301030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:51.412649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7f66f-5db8-4475-bd79-e38991102472 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:51.450743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893298-af58-4ec8-9c90-da4cf5b34c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:51.454153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893298-af58-4ec8-9c90-da4cf5b34c14 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:51.454459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893298-af58-4ec8-9c90-da4cf5b34c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:51.454742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893298-af58-4ec8-9c90-da4cf5b34c14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:51.466300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36893298-af58-4ec8-9c90-da4cf5b34c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-36893298-af58-4ec8-9c90-da4cf5b34c14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:22:51.475013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:51.476434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:51.477521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 626/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:22:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:51.482663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f40e62-5464-4c5a-b70d-dda079159ebf None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:51.591428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f40e62-5464-4c5a-b70d-dda079159ebf None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:51.627030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:51.633357 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92d3d5-0cb0-4eed-b149-2865d3048387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:51.634322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d3d5-0cb0-4eed-b149-2865d3048387 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:51.634641 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d3d5-0cb0-4eed-b149-2865d3048387 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:51.634930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d3d5-0cb0-4eed-b149-2865d3048387 None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:51.635951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92d3d5-0cb0-4eed-b149-2865d3048387 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:51.636397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92d3d5-0cb0-4eed-b149-2865d3048387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:51.638114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92d3d5-0cb0-4eed-b149-2865d3048387 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:51.649828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 624/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:22:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:22:51.656502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893298-af58-4ec8-9c90-da4cf5b34c14 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:51.750132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:51.780081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893298-af58-4ec8-9c90-da4cf5b34c14 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:51.820079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54ad55-f55a-4b64-9fca-100598201d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:51.821122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54ad55-f55a-4b64-9fca-100598201d15 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:51.821561 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54ad55-f55a-4b64-9fca-100598201d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:51.821941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54ad55-f55a-4b64-9fca-100598201d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:51.833544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54ad55-f55a-4b64-9fca-100598201d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:51.835119 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54ad55-f55a-4b64-9fca-100598201d15 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-3c54ad55-f55a-4b64-9fca-100598201d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:51.854542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:51.855577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:51.856503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:51.856503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:51.856503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:51.856503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:51.856503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 627/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:51.862854 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92d3d5-0cb0-4eed-b149-2865d3048387 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:51.972205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92d3d5-0cb0-4eed-b149-2865d3048387 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:52.009157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44998f2d-910c-42b4-a4b6-c59efd0fb02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:52.009752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44998f2d-910c-42b4-a4b6-c59efd0fb02f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:52.010039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44998f2d-910c-42b4-a4b6-c59efd0fb02f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:52.010321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44998f2d-910c-42b4-a4b6-c59efd0fb02f None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:52.011166 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44998f2d-910c-42b4-a4b6-c59efd0fb02f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:52.011571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44998f2d-910c-42b4-a4b6-c59efd0fb02f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:52.013003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44998f2d-910c-42b4-a4b6-c59efd0fb02f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:52.025819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 625/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:52.032344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54ad55-f55a-4b64-9fca-100598201d15 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:52.160879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54ad55-f55a-4b64-9fca-100598201d15 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:52.192772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:52.203027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70b71-8410-4a95-9070-ddcfed96367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:52.203898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70b71-8410-4a95-9070-ddcfed96367b None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:52.204275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70b71-8410-4a95-9070-ddcfed96367b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:52.204614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70b71-8410-4a95-9070-ddcfed96367b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:52.212501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a70b71-8410-4a95-9070-ddcfed96367b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:52.213963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a70b71-8410-4a95-9070-ddcfed96367b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a4a70b71-8410-4a95-9070-ddcfed96367b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:22:52.228423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:52.229414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:52.230924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 628/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:52.235713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44998f2d-910c-42b4-a4b6-c59efd0fb02f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:52.300909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:52.354101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44998f2d-910c-42b4-a4b6-c59efd0fb02f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:52.398066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0b370-1b3a-4d31-a415-fb7c5a45e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:52.399221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0b370-1b3a-4d31-a415-fb7c5a45e46e None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:52.399685 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0b370-1b3a-4d31-a415-fb7c5a45e46e None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:52.400191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0b370-1b3a-4d31-a415-fb7c5a45e46e None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:52.402997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0b370-1b3a-4d31-a415-fb7c5a45e46e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:52.403464 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0b370-1b3a-4d31-a415-fb7c5a45e46e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:52.406214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0b370-1b3a-4d31-a415-fb7c5a45e46e None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:52.428975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 626/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Jun 24 10:22:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:22:52.437199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70b71-8410-4a95-9070-ddcfed96367b None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:52.553486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70b71-8410-4a95-9070-ddcfed96367b None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:52.594794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd3eb8-ec08-4be1-a26f-10061fa22de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:52.595457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd3eb8-ec08-4be1-a26f-10061fa22de8 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:52.595746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd3eb8-ec08-4be1-a26f-10061fa22de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:52.596031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd3eb8-ec08-4be1-a26f-10061fa22de8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:52.657742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:52.672174 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd3eb8-ec08-4be1-a26f-10061fa22de8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:52.673768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd3eb8-ec08-4be1-a26f-10061fa22de8 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:52.775941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 629/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:22:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:22:52.781999 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0b370-1b3a-4d31-a415-fb7c5a45e46e None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:52.885990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0b370-1b3a-4d31-a415-fb7c5a45e46e None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:52.899828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:52.923861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7da6de-bb42-4fb4-a0fc-aef0e731b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:52.924756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7da6de-bb42-4fb4-a0fc-aef0e731b7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:52.925034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7da6de-bb42-4fb4-a0fc-aef0e731b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:52.925307 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7da6de-bb42-4fb4-a0fc-aef0e731b7b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:52.936031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7da6de-bb42-4fb4-a0fc-aef0e731b7b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:52.937479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7da6de-bb42-4fb4-a0fc-aef0e731b7b9 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-2d7da6de-bb42-4fb4-a0fc-aef0e731b7b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:52.955023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:52.956159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:52.957247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:52.957247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:52.957247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:52.957247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:52.961163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 627/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:22:52.962542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd3eb8-ec08-4be1-a26f-10061fa22de8 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:53.055830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:53.068860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd3eb8-ec08-4be1-a26f-10061fa22de8 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:53.103491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142352-07df-408c-9c92-713c45a5d586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:53.104284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142352-07df-408c-9c92-713c45a5d586 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:53.104584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142352-07df-408c-9c92-713c45a5d586 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:53.104870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142352-07df-408c-9c92-713c45a5d586 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:53.105733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142352-07df-408c-9c92-713c45a5d586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:53.106081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142352-07df-408c-9c92-713c45a5d586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:53.108182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142352-07df-408c-9c92-713c45a5d586 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:53.120363 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 630/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:22:53.126709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7da6de-bb42-4fb4-a0fc-aef0e731b7b9 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:53.239919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7da6de-bb42-4fb4-a0fc-aef0e731b7b9 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:53.287707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75010ecb-37bd-49ae-a8f0-134d3aa4caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:53.288499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75010ecb-37bd-49ae-a8f0-134d3aa4caa4 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:53.288781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75010ecb-37bd-49ae-a8f0-134d3aa4caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:53.289055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75010ecb-37bd-49ae-a8f0-134d3aa4caa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:53.297845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75010ecb-37bd-49ae-a8f0-134d3aa4caa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:53.299451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75010ecb-37bd-49ae-a8f0-134d3aa4caa4 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-75010ecb-37bd-49ae-a8f0-134d3aa4caa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:22:53.314121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:53.315368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:53.321910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:22:53.321910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:22:53.321910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:22:53.321910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:22:53.321910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:22:53.321910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:22:53.321910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:22:53.321910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:53.321910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 628/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:22:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:53.322719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142352-07df-408c-9c92-713c45a5d586 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:53.447385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142352-07df-408c-9c92-713c45a5d586 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:53.484506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9bbe0-25ab-4bde-9981-bcaa31f124d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:53.485112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9bbe0-25ab-4bde-9981-bcaa31f124d9 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:53.485397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9bbe0-25ab-4bde-9981-bcaa31f124d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:53.485673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9bbe0-25ab-4bde-9981-bcaa31f124d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:53.486501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9bbe0-25ab-4bde-9981-bcaa31f124d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:53.486813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9bbe0-25ab-4bde-9981-bcaa31f124d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:53.488247 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9bbe0-25ab-4bde-9981-bcaa31f124d9 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:53.501413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 631/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:22:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:53.507426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75010ecb-37bd-49ae-a8f0-134d3aa4caa4 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:53.536818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:53.622469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75010ecb-37bd-49ae-a8f0-134d3aa4caa4 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:53.659153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed5481-d1c9-497d-b05a-33f752bd1d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:53.659817 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed5481-d1c9-497d-b05a-33f752bd1d6a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:53.660099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed5481-d1c9-497d-b05a-33f752bd1d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:53.660374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed5481-d1c9-497d-b05a-33f752bd1d6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:53.661209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed5481-d1c9-497d-b05a-33f752bd1d6a None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=06d6f1eebcfa48349613455eb5d2aaf0) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:53.661520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed5481-d1c9-497d-b05a-33f752bd1d6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:53.663013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed5481-d1c9-497d-b05a-33f752bd1d6a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:53.669598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 629/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:22:53 2022] GET /identity/v3/role_assignments?user.id=06d6f1eebcfa48349613455eb5d2aaf0&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:55.690370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d6ee-14bc-4cf2-8ada-1a7b76cbca09 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:55.690928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d6ee-14bc-4cf2-8ada-1a7b76cbca09 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:55.691029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d6ee-14bc-4cf2-8ada-1a7b76cbca09 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:55.692333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 632/1261] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:22:55.697373 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d7754-3a33-40ba-ab6e-553aebbe1954 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:55.697762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d7754-3a33-40ba-ab6e-553aebbe1954 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:55.697931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d7754-3a33-40ba-ab6e-553aebbe1954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:55.714705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-634d7754-3a33-40ba-ab6e-553aebbe1954 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:22:55.715870 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-634d7754-3a33-40ba-ab6e-553aebbe1954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:22:55.779201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 630/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:22:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:22:55.801715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5d6ee-14bc-4cf2-8ada-1a7b76cbca09 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:55.813105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:55.901808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5d6ee-14bc-4cf2-8ada-1a7b76cbca09 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:55.935024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e679dc9-447f-4ef3-8b6b-f0a95219d065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:55.936294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e679dc9-447f-4ef3-8b6b-f0a95219d065 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:55.936580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e679dc9-447f-4ef3-8b6b-f0a95219d065 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:55.936859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e679dc9-447f-4ef3-8b6b-f0a95219d065 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:55.946806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e679dc9-447f-4ef3-8b6b-f0a95219d065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-1e679dc9-447f-4ef3-8b6b-f0a95219d065 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:22:55.954470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:55.955633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:55.956734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 633/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:22:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:55.961557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d7754-3a33-40ba-ab6e-553aebbe1954 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:55.979048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:56.057078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d7754-3a33-40ba-ab6e-553aebbe1954 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:56.089313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26aec-6946-4579-99c7-067a214a6c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:56.089965 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26aec-6946-4579-99c7-067a214a6c3b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:56.090247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26aec-6946-4579-99c7-067a214a6c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:56.090544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26aec-6946-4579-99c7-067a214a6c3b None admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:56.091320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e26aec-6946-4579-99c7-067a214a6c3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:56.091668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e26aec-6946-4579-99c7-067a214a6c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:56.093019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e26aec-6946-4579-99c7-067a214a6c3b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:56.100721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 631/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:22:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:56.106241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e679dc9-447f-4ef3-8b6b-f0a95219d065 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:56.179043 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:56.211779 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e679dc9-447f-4ef3-8b6b-f0a95219d065 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:56.244428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107986a4-b31a-4566-b3bb-f215afd8d2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:56.245203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107986a4-b31a-4566-b3bb-f215afd8d2ed None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:56.245487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107986a4-b31a-4566-b3bb-f215afd8d2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:56.245762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107986a4-b31a-4566-b3bb-f215afd8d2ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:56.255977 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107986a4-b31a-4566-b3bb-f215afd8d2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:56.257413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107986a4-b31a-4566-b3bb-f215afd8d2ed None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-107986a4-b31a-4566-b3bb-f215afd8d2ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:56.273777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:56.274852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:56.276127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:56.276127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:56.276127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:56.276127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:56.276127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 634/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:56.281254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26aec-6946-4579-99c7-067a214a6c3b None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:56.366275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:56.386780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26aec-6946-4579-99c7-067a214a6c3b None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:56.420313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5ee84-5cc0-46e3-9f22-48f03589f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:56.420965 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5ee84-5cc0-46e3-9f22-48f03589f66f None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:56.421251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5ee84-5cc0-46e3-9f22-48f03589f66f None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:56.421529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5ee84-5cc0-46e3-9f22-48f03589f66f None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:56.422254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5ee84-5cc0-46e3-9f22-48f03589f66f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:56.422591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5ee84-5cc0-46e3-9f22-48f03589f66f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:56.423956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5ee84-5cc0-46e3-9f22-48f03589f66f None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:56.435259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 632/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:56.440883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107986a4-b31a-4566-b3bb-f215afd8d2ed None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:56.546493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107986a4-b31a-4566-b3bb-f215afd8d2ed None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:56.565478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:56.580262 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aaf4f7-619a-4f2b-b90a-92e978b3f552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:56.581060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaf4f7-619a-4f2b-b90a-92e978b3f552 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:56.581350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaf4f7-619a-4f2b-b90a-92e978b3f552 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:56.581631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaf4f7-619a-4f2b-b90a-92e978b3f552 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:56.589104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aaf4f7-619a-4f2b-b90a-92e978b3f552 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:56.590575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aaf4f7-619a-4f2b-b90a-92e978b3f552 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-21aaf4f7-619a-4f2b-b90a-92e978b3f552 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:22:56.605049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:56.606180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:56.607411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 635/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:56.612136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5ee84-5cc0-46e3-9f22-48f03589f66f None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:56.708315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5ee84-5cc0-46e3-9f22-48f03589f66f None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:56.740895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bb0b9-c497-45c1-a279-56aabcc98bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:56.741548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bb0b9-c497-45c1-a279-56aabcc98bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:56.741833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bb0b9-c497-45c1-a279-56aabcc98bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:56.742109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bb0b9-c497-45c1-a279-56aabcc98bc6 None admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:56.742967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bb0b9-c497-45c1-a279-56aabcc98bc6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:56.743277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bb0b9-c497-45c1-a279-56aabcc98bc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:56.744701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bb0b9-c497-45c1-a279-56aabcc98bc6 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:56.753021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:56.762081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 633/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Jun 24 10:22:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:56.768159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aaf4f7-619a-4f2b-b90a-92e978b3f552 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:56.865319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aaf4f7-619a-4f2b-b90a-92e978b3f552 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:56.898640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7153f13-788e-4adb-abd6-609ddbdea88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:56.899417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153f13-788e-4adb-abd6-609ddbdea88e None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:56.899701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153f13-788e-4adb-abd6-609ddbdea88e None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:56.899977 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153f13-788e-4adb-abd6-609ddbdea88e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:56.910894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7153f13-788e-4adb-abd6-609ddbdea88e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:56.912328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7153f13-788e-4adb-abd6-609ddbdea88e None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-c7153f13-788e-4adb-abd6-609ddbdea88e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:22:56.929093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:56.930128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:56.931123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:22:56.931123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:22:56.931123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:22:56.931123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:56.931123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 636/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:56.936542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bb0b9-c497-45c1-a279-56aabcc98bc6 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:57.031744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bb0b9-c497-45c1-a279-56aabcc98bc6 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:57.065163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d02d4-01b7-4d37-93a1-29b641f2061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:57.065803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d02d4-01b7-4d37-93a1-29b641f2061c None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:57.066083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d02d4-01b7-4d37-93a1-29b641f2061c None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:57.066383 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d02d4-01b7-4d37-93a1-29b641f2061c None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:57.067091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d02d4-01b7-4d37-93a1-29b641f2061c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:57.067394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d02d4-01b7-4d37-93a1-29b641f2061c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:57.068740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d02d4-01b7-4d37-93a1-29b641f2061c None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:57.079981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 634/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:57.085430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7153f13-788e-4adb-abd6-609ddbdea88e None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:57.116754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:57.182567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7153f13-788e-4adb-abd6-609ddbdea88e None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:57.215163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f740f0-5d2d-479e-aee0-4b0b73f20f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:57.215932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f740f0-5d2d-479e-aee0-4b0b73f20f80 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:57.216236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f740f0-5d2d-479e-aee0-4b0b73f20f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:57.216831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f740f0-5d2d-479e-aee0-4b0b73f20f80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:57.225301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f740f0-5d2d-479e-aee0-4b0b73f20f80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:57.226754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f740f0-5d2d-479e-aee0-4b0b73f20f80 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-17f740f0-5d2d-479e-aee0-4b0b73f20f80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:22:57.240609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:57.241659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:57.243003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:22:57.243003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:22:57.243003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:22:57.243003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:22:57.243003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:22:57.243003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:22:57.243003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:22:57.243003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:22:57.243003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 637/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:22:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:57.248093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d02d4-01b7-4d37-93a1-29b641f2061c None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:57.305022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:57.351017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d02d4-01b7-4d37-93a1-29b641f2061c None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:57.384040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421f812-f262-43ef-8acd-1d9b0fb26229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:57.384688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421f812-f262-43ef-8acd-1d9b0fb26229 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:57.384975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421f812-f262-43ef-8acd-1d9b0fb26229 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:57.385251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421f812-f262-43ef-8acd-1d9b0fb26229 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:57.386025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421f812-f262-43ef-8acd-1d9b0fb26229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:57.386330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421f812-f262-43ef-8acd-1d9b0fb26229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:57.387781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421f812-f262-43ef-8acd-1d9b0fb26229 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:57.399754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 635/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:22:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:57.406248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f740f0-5d2d-479e-aee0-4b0b73f20f80 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:57.492771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:57.501838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f740f0-5d2d-479e-aee0-4b0b73f20f80 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:57.534866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6a9c-4a52-4b3e-a639-73e87491f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:57.535726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6a9c-4a52-4b3e-a639-73e87491f385 None admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:57.536007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6a9c-4a52-4b3e-a639-73e87491f385 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:57.536280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6a9c-4a52-4b3e-a639-73e87491f385 None admin] PATH_INFO: `/v3/projects/ded734adca05431f9db935b5734a757b/users/06d6f1eebcfa48349613455eb5d2aaf0/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:57.538163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd6a9c-4a52-4b3e-a639-73e87491f385 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded734adca05431f9db935b5734a757b, user_id=06d6f1eebcfa48349613455eb5d2aaf0, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:57.539601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd6a9c-4a52-4b3e-a639-73e87491f385 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:57.552011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 638/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Jun 24 10:22:57 2022] PUT /identity/v3/projects/ded734adca05431f9db935b5734a757b/users/06d6f1eebcfa48349613455eb5d2aaf0/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:22:59.546484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40a75-27d6-4112-b7c9-40ab8f390b66 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:59.547036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40a75-27d6-4112-b7c9-40ab8f390b66 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:59.547036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40a75-27d6-4112-b7c9-40ab8f390b66 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:59.548435 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 636/1274] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:22:59.553422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e35e-8175-428e-af61-36aeb9cc5396 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:59.553820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e35e-8175-428e-af61-36aeb9cc5396 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:59.554045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e35e-8175-428e-af61-36aeb9cc5396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:59.570457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-9058e35e-8175-428e-af61-36aeb9cc5396 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:22:59.571620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9058e35e-8175-428e-af61-36aeb9cc5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:22:59.636514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 639/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:22:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:22:59.662109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce40a75-27d6-4112-b7c9-40ab8f390b66 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:59.759047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce40a75-27d6-4112-b7c9-40ab8f390b66 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:59.775873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:59.793151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9234e-d679-4e81-bfdd-31c6d4becc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:59.793921 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9234e-d679-4e81-bfdd-31c6d4becc22 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:59.794228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9234e-d679-4e81-bfdd-31c6d4becc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:59.794540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9234e-d679-4e81-bfdd-31c6d4becc22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:59.804267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9234e-d679-4e81-bfdd-31c6d4becc22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-f2e9234e-d679-4e81-bfdd-31c6d4becc22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 10:22:59.811684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:22:59.812803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:22:59.813989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 637/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Jun 24 10:22:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:22:59.818765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058e35e-8175-428e-af61-36aeb9cc5396 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:22:59.897763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:59.916505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058e35e-8175-428e-af61-36aeb9cc5396 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:22:59.948947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e43339-0a70-406d-8c23-8e96aa32a0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:22:59.949599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e43339-0a70-406d-8c23-8e96aa32a0ff None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:22:59.949885 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e43339-0a70-406d-8c23-8e96aa32a0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:22:59.950164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e43339-0a70-406d-8c23-8e96aa32a0ff None admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:22:59.951457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e43339-0a70-406d-8c23-8e96aa32a0ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:22:59.951764 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e43339-0a70-406d-8c23-8e96aa32a0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:22:59.953112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e43339-0a70-406d-8c23-8e96aa32a0ff None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:22:59.960893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 640/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Jun 24 10:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:22:59.966558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9234e-d679-4e81-bfdd-31c6d4becc22 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:00.062247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9234e-d679-4e81-bfdd-31c6d4becc22 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:00.094020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9b44c-f740-4908-b669-1f3f8576dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:00.094809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9b44c-f740-4908-b669-1f3f8576dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:00.095088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9b44c-f740-4908-b669-1f3f8576dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:00.095357 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9b44c-f740-4908-b669-1f3f8576dcb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:00.105370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9b44c-f740-4908-b669-1f3f8576dcb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:00.106849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9b44c-f740-4908-b669-1f3f8576dcb3 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-39c9b44c-f740-4908-b669-1f3f8576dcb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:23:00.123574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:23:00.124620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:23:00.130312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:23:00.130312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:23:00.130312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:23:00.130312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:00.130312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 638/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:23:00.130661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e43339-0a70-406d-8c23-8e96aa32a0ff None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:00.228368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e43339-0a70-406d-8c23-8e96aa32a0ff None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:00.260441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfc2ed-486d-4e99-80b0-d6376afd5279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:00.261090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfc2ed-486d-4e99-80b0-d6376afd5279 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:00.261375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfc2ed-486d-4e99-80b0-d6376afd5279 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:00.261650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfc2ed-486d-4e99-80b0-d6376afd5279 None admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:00.262382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfc2ed-486d-4e99-80b0-d6376afd5279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:23:00.262771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfc2ed-486d-4e99-80b0-d6376afd5279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:00.264626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfc2ed-486d-4e99-80b0-d6376afd5279 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:00.275980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 641/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:23:00.281552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9b44c-f740-4908-b669-1f3f8576dcb3 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:00.312466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:00.380021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9b44c-f740-4908-b669-1f3f8576dcb3 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:00.412185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57966631-064a-4811-a2aa-e29c163ee8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:00.412971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966631-064a-4811-a2aa-e29c163ee8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:00.413257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966631-064a-4811-a2aa-e29c163ee8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:00.413534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966631-064a-4811-a2aa-e29c163ee8e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:00.421566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57966631-064a-4811-a2aa-e29c163ee8e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:00.423037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57966631-064a-4811-a2aa-e29c163ee8e1 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-57966631-064a-4811-a2aa-e29c163ee8e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 10:23:00.437429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:23:00.438569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:00.439579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 639/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:23:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:23:00.444358 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfc2ed-486d-4e99-80b0-d6376afd5279 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:00.448063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:00.542023 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfc2ed-486d-4e99-80b0-d6376afd5279 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:00.575677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23abba-6117-486d-819e-ea80283db68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:00.576341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23abba-6117-486d-819e-ea80283db68a None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:00.576627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23abba-6117-486d-819e-ea80283db68a None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:00.576904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23abba-6117-486d-819e-ea80283db68a None admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:00.577739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23abba-6117-486d-819e-ea80283db68a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:23:00.578050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23abba-6117-486d-819e-ea80283db68a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:00.579522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23abba-6117-486d-819e-ea80283db68a None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:00.596493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 642/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Jun 24 10:23:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:23:00.602120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57966631-064a-4811-a2aa-e29c163ee8e1 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:00.691567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:00.701513 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57966631-064a-4811-a2aa-e29c163ee8e1 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:00.734615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff22a32-3e69-40b0-8b4b-030b8909a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:00.735250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff22a32-3e69-40b0-8b4b-030b8909a319 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:00.735536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff22a32-3e69-40b0-8b4b-030b8909a319 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:00.735814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff22a32-3e69-40b0-8b4b-030b8909a319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:00.800405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff22a32-3e69-40b0-8b4b-030b8909a319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:00.801833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff22a32-3e69-40b0-8b4b-030b8909a319 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:00.893916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:00.906296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 640/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Jun 24 10:23:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 10:23:00.912675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23abba-6117-486d-819e-ea80283db68a None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:00.971959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:01.009076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23abba-6117-486d-819e-ea80283db68a None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:01.041853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abbb09-f4bb-4ffa-a9fd-85edb50fa082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:01.042653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abbb09-f4bb-4ffa-a9fd-85edb50fa082 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:01.042936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abbb09-f4bb-4ffa-a9fd-85edb50fa082 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:01.043211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abbb09-f4bb-4ffa-a9fd-85edb50fa082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:01.053685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abbb09-f4bb-4ffa-a9fd-85edb50fa082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:01.055260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abbb09-f4bb-4ffa-a9fd-85edb50fa082 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-29abbb09-f4bb-4ffa-a9fd-85edb50fa082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 10:23:01.072334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:23:01.073397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:23:01.074377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 10:23:01.074377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 10:23:01.074377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 10:23:01.074377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:23:01.074377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 643/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 10:23:01.079632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff22a32-3e69-40b0-8b4b-030b8909a319 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:01.175752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff22a32-3e69-40b0-8b4b-030b8909a319 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:01.208582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa265165-696b-4ed2-89d2-8d6a8d53954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:01.209232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa265165-696b-4ed2-89d2-8d6a8d53954a None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:01.209517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa265165-696b-4ed2-89d2-8d6a8d53954a None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:01.209794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa265165-696b-4ed2-89d2-8d6a8d53954a None admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:01.210535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa265165-696b-4ed2-89d2-8d6a8d53954a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:23:01.210843 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa265165-696b-4ed2-89d2-8d6a8d53954a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:01.212197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa265165-696b-4ed2-89d2-8d6a8d53954a None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:01.223663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 641/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Jun 24 10:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:23:01.229061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abbb09-f4bb-4ffa-a9fd-85edb50fa082 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:01.331441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abbb09-f4bb-4ffa-a9fd-85edb50fa082 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:01.345464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:01.365631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107ddd-c114-4640-830f-3fe2efc33db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:01.366440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107ddd-c114-4640-830f-3fe2efc33db4 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:01.366729 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107ddd-c114-4640-830f-3fe2efc33db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:01.367007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107ddd-c114-4640-830f-3fe2efc33db4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:01.373563 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107ddd-c114-4640-830f-3fe2efc33db4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:01.375029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9107ddd-c114-4640-830f-3fe2efc33db4 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application [None req-a9107ddd-c114-4640-830f-3fe2efc33db4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 10:23:01.388935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application with Lock( Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:23:01.389963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:23:01.390955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 10:23:01.390955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 10:23:01.390955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 10:23:01.390955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 10:23:01.390955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 10:23:01.390955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 10:23:01.390955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 10:23:01.390955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: ERROR keystone.server.flask.application Jun 24 10:23:01.390955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 644/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Jun 24 10:23:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:23:01.395862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa265165-696b-4ed2-89d2-8d6a8d53954a None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:01.444786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:01.493455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa265165-696b-4ed2-89d2-8d6a8d53954a None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:01.524940 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b288703-2567-4073-b495-ce3d34463646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:01.525576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b288703-2567-4073-b495-ce3d34463646 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:01.525857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b288703-2567-4073-b495-ce3d34463646 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:01.526131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b288703-2567-4073-b495-ce3d34463646 None admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:01.527051 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b288703-2567-4073-b495-ce3d34463646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:23:01.527358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b288703-2567-4073-b495-ce3d34463646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:01.529279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b288703-2567-4073-b495-ce3d34463646 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:01.540998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 642/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Jun 24 10:23:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:23:01.547405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107ddd-c114-4640-830f-3fe2efc33db4 None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:01.645044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107ddd-c114-4640-830f-3fe2efc33db4 None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:01.683273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19192d9-6945-4cf9-b806-503a7cc9f445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:01.683920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19192d9-6945-4cf9-b806-503a7cc9f445 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:01.684204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19192d9-6945-4cf9-b806-503a7cc9f445 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:01.684482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19192d9-6945-4cf9-b806-503a7cc9f445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:01.685299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19192d9-6945-4cf9-b806-503a7cc9f445 None admin] RBAC: Adding query filter params (role.id=ef5f12c980f84a119b085158a63e6b22, scope.project.id=ded734adca05431f9db935b5734a757b, user.id=06d6f1eebcfa48349613455eb5d2aaf0) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:23:01.685611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19192d9-6945-4cf9-b806-503a7cc9f445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:01.687068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19192d9-6945-4cf9-b806-503a7cc9f445 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:01.692788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 645/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Jun 24 10:23:01 2022] GET /identity/v3/role_assignments?user.id=06d6f1eebcfa48349613455eb5d2aaf0&scope.project.id=ded734adca05431f9db935b5734a757b&role.id=ef5f12c980f84a119b085158a63e6b22 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:23:03.693751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f090edf-ec3b-496b-af0d-97f56598b2cb None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:03.694306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f090edf-ec3b-496b-af0d-97f56598b2cb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:03.694306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f090edf-ec3b-496b-af0d-97f56598b2cb None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:03.695688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 643/1288] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:23:03.701364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3937de-972e-4178-b900-b32e4638e408 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:03.701788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3937de-972e-4178-b900-b32e4638e408 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:03.701923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3937de-972e-4178-b900-b32e4638e408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:03.718291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-be3937de-972e-4178-b900-b32e4638e408 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:23:03.719509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-be3937de-972e-4178-b900-b32e4638e408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:23:03.748095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:03.788047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 646/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:23:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:23:03.810651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f090edf-ec3b-496b-af0d-97f56598b2cb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:03.908567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f090edf-ec3b-496b-af0d-97f56598b2cb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:03.919553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:03.942023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b6a5-cbf8-40f5-b432-053291668a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:03.942834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b6a5-cbf8-40f5-b432-053291668a11 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:03.943120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b6a5-cbf8-40f5-b432-053291668a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:03.943405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b6a5-cbf8-40f5-b432-053291668a11 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:03.944049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04b6a5-cbf8-40f5-b432-053291668a11 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:03.945411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04b6a5-cbf8-40f5-b432-053291668a11 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-9c04b6a5-cbf8-40f5-b432-053291668a11 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:23:03.956916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:23:03.958145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:03.959375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 644/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Jun 24 10:23:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:23:03.964048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3937de-972e-4178-b900-b32e4638e408 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:04.062583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3937de-972e-4178-b900-b32e4638e408 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:04.095546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2ff43-7803-4edd-89f4-0644646a39ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:04.096197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2ff43-7803-4edd-89f4-0644646a39ef None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:04.096483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2ff43-7803-4edd-89f4-0644646a39ef None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:04.096761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2ff43-7803-4edd-89f4-0644646a39ef None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:04.097457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2ff43-7803-4edd-89f4-0644646a39ef None admin] RBAC: Adding query filter params (name=placement) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:23:04.097764 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2ff43-7803-4edd-89f4-0644646a39ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:04.099148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2ff43-7803-4edd-89f4-0644646a39ef None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:04.103841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 647/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Fri Jun 24 10:23:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:23:04.109490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b6a5-cbf8-40f5-b432-053291668a11 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:04.211854 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b6a5-cbf8-40f5-b432-053291668a11 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:04.244084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24720e45-a8c2-407c-b34b-3c27a12b6611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:04.244734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24720e45-a8c2-407c-b34b-3c27a12b6611 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:04.245017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24720e45-a8c2-407c-b34b-3c27a12b6611 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:04.245291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24720e45-a8c2-407c-b34b-3c27a12b6611 None admin] PATH_INFO: `/v3/services` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:04.245991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24720e45-a8c2-407c-b34b-3c27a12b6611 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:23:04.246299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24720e45-a8c2-407c-b34b-3c27a12b6611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:04.247716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24720e45-a8c2-407c-b34b-3c27a12b6611 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:04.252048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 645/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Fri Jun 24 10:23:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:23:06.262573 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eab028-dd8e-4ede-a7bc-7cada6e46a6a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:06.263133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eab028-dd8e-4ede-a7bc-7cada6e46a6a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:06.263133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eab028-dd8e-4ede-a7bc-7cada6e46a6a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:06.264560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 648/1293] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:23:06.269828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ed4c2-dc62-4676-9a5b-ea2e277842ba None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:06.270245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ed4c2-dc62-4676-9a5b-ea2e277842ba None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:06.270384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ed4c2-dc62-4676-9a5b-ea2e277842ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:06.287104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-051ed4c2-dc62-4676-9a5b-ea2e277842ba None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:23:06.288273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-051ed4c2-dc62-4676-9a5b-ea2e277842ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:23:06.319069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:06.363852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 646/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:23:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:23:06.390204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eab028-dd8e-4ede-a7bc-7cada6e46a6a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:06.423127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:06.492380 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eab028-dd8e-4ede-a7bc-7cada6e46a6a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:06.525238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d6db3-6c93-4941-95c7-717e6c86e18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:06.525829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6db3-6c93-4941-95c7-717e6c86e18b None admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:06.526115 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6db3-6c93-4941-95c7-717e6c86e18b None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:06.526416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6db3-6c93-4941-95c7-717e6c86e18b None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:06.527126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d6db3-6c93-4941-95c7-717e6c86e18b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:06.529035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d6db3-6c93-4941-95c7-717e6c86e18b None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:06.541888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 649/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Jun 24 10:23:06 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:23:08.538266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60072e16-d777-4430-80f1-bd83d0a104b5 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:08.538819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60072e16-d777-4430-80f1-bd83d0a104b5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:08.538936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60072e16-d777-4430-80f1-bd83d0a104b5 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:08.540223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 647/1296] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:23:08.546215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396d89-d05e-4ed6-b783-fe09916cd1dc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:08.546628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396d89-d05e-4ed6-b783-fe09916cd1dc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:08.546809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396d89-d05e-4ed6-b783-fe09916cd1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:08.563211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5a396d89-d05e-4ed6-b783-fe09916cd1dc None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:23:08.564402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5a396d89-d05e-4ed6-b783-fe09916cd1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:23:08.636051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 650/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:23:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:23:08.659813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60072e16-d777-4430-80f1-bd83d0a104b5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:08.757511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60072e16-d777-4430-80f1-bd83d0a104b5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:08.790862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742e12-367e-4d3b-930a-3f9e646e0654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:08.791579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742e12-367e-4d3b-930a-3f9e646e0654 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:08.791861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742e12-367e-4d3b-930a-3f9e646e0654 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:08.792136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742e12-367e-4d3b-930a-3f9e646e0654 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:08.792778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca742e12-367e-4d3b-930a-3f9e646e0654 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:08.794177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca742e12-367e-4d3b-930a-3f9e646e0654 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-ca742e12-367e-4d3b-930a-3f9e646e0654 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:23:08.805528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:23:08.806719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:08.807786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 648/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Jun 24 10:23:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:23:08.812751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a396d89-d05e-4ed6-b783-fe09916cd1dc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:08.830607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:08.910571 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a396d89-d05e-4ed6-b783-fe09916cd1dc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:08.944452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1f387-072e-445a-9823-0a77943a00eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:08.945100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1f387-072e-445a-9823-0a77943a00eb None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:08.945382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1f387-072e-445a-9823-0a77943a00eb None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:08.945659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1f387-072e-445a-9823-0a77943a00eb None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:08.946367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1f387-072e-445a-9823-0a77943a00eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:23:08.946678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1f387-072e-445a-9823-0a77943a00eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:08.948020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1f387-072e-445a-9823-0a77943a00eb None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:08.953592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 651/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Fri Jun 24 10:23:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:23:08.962479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742e12-367e-4d3b-930a-3f9e646e0654 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:08.992978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:09.060563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742e12-367e-4d3b-930a-3f9e646e0654 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:09.093162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446dec2f-2f2a-4a7a-b94f-a8cf1b66859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:09.093803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dec2f-2f2a-4a7a-b94f-a8cf1b66859b None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:09.094090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dec2f-2f2a-4a7a-b94f-a8cf1b66859b None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:09.094391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dec2f-2f2a-4a7a-b94f-a8cf1b66859b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:09.095175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446dec2f-2f2a-4a7a-b94f-a8cf1b66859b None admin] RBAC: Adding query filter params (interface=public, service_id=f0204961a0834a69ba0d097b5d5e02a0, region_id=RegionOne) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:23:09.095487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446dec2f-2f2a-4a7a-b94f-a8cf1b66859b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:09.096842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446dec2f-2f2a-4a7a-b94f-a8cf1b66859b None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:09.101792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 649/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Jun 24 10:23:08 2022] GET /identity/v3/endpoints?service_id=f0204961a0834a69ba0d097b5d5e02a0&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:23:09.107206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1f387-072e-445a-9823-0a77943a00eb None admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:09.185620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:09.204857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1f387-072e-445a-9823-0a77943a00eb None admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:09.236592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fbb84-49ab-4ec6-8c04-f607a2f5d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:09.237229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fbb84-49ab-4ec6-8c04-f607a2f5d0de None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:09.237516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fbb84-49ab-4ec6-8c04-f607a2f5d0de None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:09.237791 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fbb84-49ab-4ec6-8c04-f607a2f5d0de None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:09.238483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fbb84-49ab-4ec6-8c04-f607a2f5d0de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:09.239825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fbb84-49ab-4ec6-8c04-f607a2f5d0de None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:09.247079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 652/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Jun 24 10:23:09 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:23:11.271786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433acb41-b8d1-434d-bd9e-ab2ee2ccc5ec None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:11.272316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433acb41-b8d1-434d-bd9e-ab2ee2ccc5ec None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:11.272316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433acb41-b8d1-434d-bd9e-ab2ee2ccc5ec None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:11.273704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 650/1302] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:23:11.278742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe7e0e-b6c5-48a8-b4c6-5f33ab467ac5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:11.279147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe7e0e-b6c5-48a8-b4c6-5f33ab467ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:11.279299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe7e0e-b6c5-48a8-b4c6-5f33ab467ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:11.295815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3bfe7e0e-b6c5-48a8-b4c6-5f33ab467ac5 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:23:11.296992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3bfe7e0e-b6c5-48a8-b4c6-5f33ab467ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:23:11.367914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 653/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:23:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 10:23:11.393260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433acb41-b8d1-434d-bd9e-ab2ee2ccc5ec None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:11.486417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:11.493537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433acb41-b8d1-434d-bd9e-ab2ee2ccc5ec None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:11.526194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c1c23-9093-486b-86a1-d457eab9e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:11.527002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c1c23-9093-486b-86a1-d457eab9e982 None admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:11.527288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c1c23-9093-486b-86a1-d457eab9e982 None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:11.527590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c1c23-9093-486b-86a1-d457eab9e982 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:11.528242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c1c23-9093-486b-86a1-d457eab9e982 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:11.529598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c1c23-9093-486b-86a1-d457eab9e982 None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application [None req-f82c1c23-9093-486b-86a1-d457eab9e982 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 10:23:11.541368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 10:23:11.542539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application with Lock( Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self._enter() Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application return self.creator() Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application created_value = creator( Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: ERROR keystone.server.flask.application Jun 24 10:23:11.544130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 651/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Jun 24 10:23:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 10:23:11.549027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe7e0e-b6c5-48a8-b4c6-5f33ab467ac5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:11.623870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:11.646296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe7e0e-b6c5-48a8-b4c6-5f33ab467ac5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:11.679685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f51503-d2ba-4b6c-b179-5c6afdff5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:11.680336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f51503-d2ba-4b6c-b179-5c6afdff5ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:11.680622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f51503-d2ba-4b6c-b179-5c6afdff5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:11.680907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f51503-d2ba-4b6c-b179-5c6afdff5ec1 None admin] PATH_INFO: `/v3/services` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:11.681604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f51503-d2ba-4b6c-b179-5c6afdff5ec1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:23:11.681912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f51503-d2ba-4b6c-b179-5c6afdff5ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:11.683302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f51503-d2ba-4b6c-b179-5c6afdff5ec1 None admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:11.688903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 654/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Fri Jun 24 10:23:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:23:11.694815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c1c23-9093-486b-86a1-d457eab9e982 None admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:23:11.792030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c1c23-9093-486b-86a1-d457eab9e982 None admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:23:11.824941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbf28a-93a0-491e-a8f6-be149ead23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:23:11.825590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf28a-93a0-491e-a8f6-be149ead23cb None admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:23:11.825878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf28a-93a0-491e-a8f6-be149ead23cb None admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:23:11.826156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf28a-93a0-491e-a8f6-be149ead23cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:23:11.826917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbf28a-93a0-491e-a8f6-be149ead23cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:23:11.828306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbf28a-93a0-491e-a8f6-be149ead23cb None admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:23:11.845674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 652/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Jun 24 10:23:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:23:21.685930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=30 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:21.841463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:14.639160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f620-d654-4a42-a6d5-4d8b41890b32 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:14.639605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f620-d654-4a42-a6d5-4d8b41890b32 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:14.639806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f620-d654-4a42-a6d5-4d8b41890b32 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:14.644782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 655/1307] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:14.646461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cfc72-12d1-4d5d-b9a5-ec88fa58e46a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:14.646865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cfc72-12d1-4d5d-b9a5-ec88fa58e46a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:14.647016 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cfc72-12d1-4d5d-b9a5-ec88fa58e46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:14.741147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-190cfc72-12d1-4d5d-b9a5-ec88fa58e46a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:14.743368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-190cfc72-12d1-4d5d-b9a5-ec88fa58e46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:14.863643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 653/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:14.914643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aade5b1-a7e3-4bde-873f-71b9aea8f5a4 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:14.915093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aade5b1-a7e3-4bde-873f-71b9aea8f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:14.915483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aade5b1-a7e3-4bde-873f-71b9aea8f5a4 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:14.917110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 656/1309] 10.222.0.44 () {54 vars in 964 bytes} [Fri Jun 24 10:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:14.923206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52a28-d47d-4c05-9882-abf9b6d62125 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:14.923754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52a28-d47d-4c05-9882-abf9b6d62125 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:14.924242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52a28-d47d-4c05-9882-abf9b6d62125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:15.007005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-68e52a28-d47d-4c05-9882-abf9b6d62125 None None] MFA Rules not processed for user `4160318c1b9b49539c6a2d8110289463`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:15.008507 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-68e52a28-d47d-4c05-9882-abf9b6d62125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:15.030546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:15.089744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 654/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Fri Jun 24 10:24:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:15.099547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aade5b1-a7e3-4bde-873f-71b9aea8f5a4 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:15.101968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4aade5b1-a7e3-4bde-873f-71b9aea8f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:15.228543 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aade5b1-a7e3-4bde-873f-71b9aea8f5a4 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:15.307822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43642c71-87c4-4aab-b56a-3a887f80aecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:15.308475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43642c71-87c4-4aab-b56a-3a887f80aecf service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:15.308784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43642c71-87c4-4aab-b56a-3a887f80aecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:15.309030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43642c71-87c4-4aab-b56a-3a887f80aecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:15.310718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-43642c71-87c4-4aab-b56a-3a887f80aecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:15.367306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:15.425245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43642c71-87c4-4aab-b56a-3a887f80aecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:15.426862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43642c71-87c4-4aab-b56a-3a887f80aecf service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:15.446904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 657/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:17.789040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b847-f1a8-4de5-bc46-92aedc411e9a None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:17.789564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b847-f1a8-4de5-bc46-92aedc411e9a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:17.789675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b847-f1a8-4de5-bc46-92aedc411e9a None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:17.791195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 655/1312] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:17.796211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026582-8767-4586-b9a9-4c66d8da8926 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:17.796643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026582-8767-4586-b9a9-4c66d8da8926 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:17.796851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026582-8767-4586-b9a9-4c66d8da8926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:17.885720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-40026582-8767-4586-b9a9-4c66d8da8926 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:17.887327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-40026582-8767-4586-b9a9-4c66d8da8926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:17.994747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 658/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:18.060078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fac6f2-d461-4fc1-9688-fe3b2a15807c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:18.060450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fac6f2-d461-4fc1-9688-fe3b2a15807c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:18.060651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fac6f2-d461-4fc1-9688-fe3b2a15807c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:18.062332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 656/1314] 10.222.0.44 () {54 vars in 964 bytes} [Fri Jun 24 10:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:18.069005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06318f-5ead-4f04-85dc-2e07275012e8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:18.069336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06318f-5ead-4f04-85dc-2e07275012e8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:18.069618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06318f-5ead-4f04-85dc-2e07275012e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:18.081424 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:18.160923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-bf06318f-5ead-4f04-85dc-2e07275012e8 None None] MFA Rules not processed for user `4160318c1b9b49539c6a2d8110289463`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:18.162553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bf06318f-5ead-4f04-85dc-2e07275012e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:18.252393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 659/1315] 10.222.0.44 () {58 vars in 1061 bytes} [Fri Jun 24 10:24:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:18.261508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fac6f2-d461-4fc1-9688-fe3b2a15807c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:18.263066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-75fac6f2-d461-4fc1-9688-fe3b2a15807c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:18.379584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fac6f2-d461-4fc1-9688-fe3b2a15807c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:18.463037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:18.466297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298386a-5b05-4299-ba3b-1040975f83e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:18.467366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298386a-5b05-4299-ba3b-1040975f83e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:18.468091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298386a-5b05-4299-ba3b-1040975f83e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:18.468800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298386a-5b05-4299-ba3b-1040975f83e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:18.470503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d298386a-5b05-4299-ba3b-1040975f83e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:18.584517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298386a-5b05-4299-ba3b-1040975f83e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:18.586773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298386a-5b05-4299-ba3b-1040975f83e1 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:18.604427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 657/1316] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:21.151222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1f439-4766-461f-8727-e76ff4429b37 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:21.151839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1f439-4766-461f-8727-e76ff4429b37 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:21.151839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1f439-4766-461f-8727-e76ff4429b37 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:21.153152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 660/1317] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:21.158145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6994-fcb6-4afc-bd42-d617a9761f17 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:21.158545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6994-fcb6-4afc-bd42-d617a9761f17 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:21.158745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6994-fcb6-4afc-bd42-d617a9761f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:21.223149 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c90d6994-fcb6-4afc-bd42-d617a9761f17 None None] MFA Rules not processed for user `69c62b93d65347deb4a3134278885674`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:21.224390 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c90d6994-fcb6-4afc-bd42-d617a9761f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:21.280867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:21.329082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 658/1318] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:21.374591 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1f439-4766-461f-8727-e76ff4429b37 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:21.376117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e6e1f439-4766-461f-8727-e76ff4429b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:21.478390 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1f439-4766-461f-8727-e76ff4429b37 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:21.481092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:21.550163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84558a8-7e24-4570-8426-da1ae8f12a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:21.550830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84558a8-7e24-4570-8426-da1ae8f12a2d service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:21.551111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84558a8-7e24-4570-8426-da1ae8f12a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:21.551383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84558a8-7e24-4570-8426-da1ae8f12a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:21.552994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b84558a8-7e24-4570-8426-da1ae8f12a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:21.662033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84558a8-7e24-4570-8426-da1ae8f12a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:21.664284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84558a8-7e24-4570-8426-da1ae8f12a2d service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:21.682818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 661/1319] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:24.371827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ab0a6-bf78-478b-89e5-a3c820733eec None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:24.372400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ab0a6-bf78-478b-89e5-a3c820733eec None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:24.372400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ab0a6-bf78-478b-89e5-a3c820733eec None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:24.373797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 659/1320] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:24.378986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19d6a2-296c-4330-baaf-f1ff187df47e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:24.379377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19d6a2-296c-4330-baaf-f1ff187df47e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:24.379551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19d6a2-296c-4330-baaf-f1ff187df47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:24.418261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:24.443679 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4b19d6a2-296c-4330-baaf-f1ff187df47e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:24.445010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4b19d6a2-296c-4330-baaf-f1ff187df47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:24.539124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 662/1321] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:24.578097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ab0a6-bf78-478b-89e5-a3c820733eec None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:24.579683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-863ab0a6-bf78-478b-89e5-a3c820733eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:24.679870 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ab0a6-bf78-478b-89e5-a3c820733eec None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:24.751210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98a4a5-79c1-4352-87d6-b71c3532ddd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:24.751849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98a4a5-79c1-4352-87d6-b71c3532ddd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:24.752132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98a4a5-79c1-4352-87d6-b71c3532ddd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:24.752407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98a4a5-79c1-4352-87d6-b71c3532ddd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:24.754025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dd98a4a5-79c1-4352-87d6-b71c3532ddd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:24.761305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:24.862263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98a4a5-79c1-4352-87d6-b71c3532ddd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:24.863714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98a4a5-79c1-4352-87d6-b71c3532ddd8 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:24.881052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 660/1322] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:27.553563 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94420a-f683-40f7-8639-1e0f9e7b23ea None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:27.554102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94420a-f683-40f7-8639-1e0f9e7b23ea None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:27.554102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94420a-f683-40f7-8639-1e0f9e7b23ea None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:27.560082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 663/1323] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:27.575658 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc6c02-53b2-47ff-96a7-9722aaa58595 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:27.576100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc6c02-53b2-47ff-96a7-9722aaa58595 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:27.576202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc6c02-53b2-47ff-96a7-9722aaa58595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:27.641274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-79bc6c02-53b2-47ff-96a7-9722aaa58595 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:27.642500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-79bc6c02-53b2-47ff-96a7-9722aaa58595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:27.702109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:27.747511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 661/1324] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:27.783835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94420a-f683-40f7-8639-1e0f9e7b23ea None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:27.785372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dc94420a-f683-40f7-8639-1e0f9e7b23ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:27.892786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94420a-f683-40f7-8639-1e0f9e7b23ea None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:27.906319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:27.968224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0bc93-85e2-4d8b-a3af-4976068fbf01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:27.968870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0bc93-85e2-4d8b-a3af-4976068fbf01 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:27.969156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0bc93-85e2-4d8b-a3af-4976068fbf01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:27.969440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0bc93-85e2-4d8b-a3af-4976068fbf01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:27.971106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f3d0bc93-85e2-4d8b-a3af-4976068fbf01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:28.078200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0bc93-85e2-4d8b-a3af-4976068fbf01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:28.079655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0bc93-85e2-4d8b-a3af-4976068fbf01 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:28.097864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 664/1325] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:30.196588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e21b0-a2f5-4e9a-86cc-48acd04018b4 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:30.197108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e21b0-a2f5-4e9a-86cc-48acd04018b4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:30.197108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e21b0-a2f5-4e9a-86cc-48acd04018b4 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:30.198443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 662/1326] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:30.203594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f9328-4177-4b93-a0f1-454252f760e3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:30.204014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f9328-4177-4b93-a0f1-454252f760e3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:30.204282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f9328-4177-4b93-a0f1-454252f760e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:30.251494 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:30.270429 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4a6f9328-4177-4b93-a0f1-454252f760e3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:30.271667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4a6f9328-4177-4b93-a0f1-454252f760e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:30.370563 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 665/1327] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:30.404458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e21b0-a2f5-4e9a-86cc-48acd04018b4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:30.406047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fe4e21b0-a2f5-4e9a-86cc-48acd04018b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:30.508301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e21b0-a2f5-4e9a-86cc-48acd04018b4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:30.586171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c3c00-546a-4f0c-b929-a34c310b9e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:30.586862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c3c00-546a-4f0c-b929-a34c310b9e5e service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:30.587148 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c3c00-546a-4f0c-b929-a34c310b9e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:30.587427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c3c00-546a-4f0c-b929-a34c310b9e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:30.589145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8a3c3c00-546a-4f0c-b929-a34c310b9e5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:30.606628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:30.704247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c3c00-546a-4f0c-b929-a34c310b9e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:30.705966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c3c00-546a-4f0c-b929-a34c310b9e5e service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:30.723972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 663/1328] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:32.823820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e0796-ae42-4af5-876f-58c78949dafb None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:32.824381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e0796-ae42-4af5-876f-58c78949dafb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:32.824381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e0796-ae42-4af5-876f-58c78949dafb None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:32.825979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 666/1329] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:32.833914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74c76d-ac5a-4c1f-a479-8c137680f6b2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:32.834408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74c76d-ac5a-4c1f-a479-8c137680f6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:32.834632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74c76d-ac5a-4c1f-a479-8c137680f6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:32.902550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2a74c76d-ac5a-4c1f-a479-8c137680f6b2 None None] MFA Rules not processed for user `69c62b93d65347deb4a3134278885674`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:32.903771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2a74c76d-ac5a-4c1f-a479-8c137680f6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:32.970843 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:33.004422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 664/1330] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:33.042503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e0796-ae42-4af5-876f-58c78949dafb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:33.044018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e51e0796-ae42-4af5-876f-58c78949dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:33.145251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e0796-ae42-4af5-876f-58c78949dafb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:33.167100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:33.221541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a79570-2fc3-4d9b-b477-650be3a181f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:33.222194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a79570-2fc3-4d9b-b477-650be3a181f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:33.222507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a79570-2fc3-4d9b-b477-650be3a181f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:33.222784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a79570-2fc3-4d9b-b477-650be3a181f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:33.224405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c9a79570-2fc3-4d9b-b477-650be3a181f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:33.344784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a79570-2fc3-4d9b-b477-650be3a181f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:33.346232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a79570-2fc3-4d9b-b477-650be3a181f3 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:33.372494 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 667/1331] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:35.637897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a19de2-3de1-45df-afc8-832ac6ac6920 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:35.638414 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a19de2-3de1-45df-afc8-832ac6ac6920 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:35.638534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a19de2-3de1-45df-afc8-832ac6ac6920 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:35.639866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 665/1332] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:35.644915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffbf46-0ace-4cfe-af5b-557058662f62 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:35.645340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffbf46-0ace-4cfe-af5b-557058662f62 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:35.645456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffbf46-0ace-4cfe-af5b-557058662f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:35.705914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:35.709557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f8ffbf46-0ace-4cfe-af5b-557058662f62 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:35.711234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f8ffbf46-0ace-4cfe-af5b-557058662f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:35.806499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 668/1333] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:35.842565 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a19de2-3de1-45df-afc8-832ac6ac6920 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:35.844084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-29a19de2-3de1-45df-afc8-832ac6ac6920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:35.945780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a19de2-3de1-45df-afc8-832ac6ac6920 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:36.023388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a267f-fcc6-42c3-ac0c-bd987c257c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:36.024036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a267f-fcc6-42c3-ac0c-bd987c257c55 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:36.024349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a267f-fcc6-42c3-ac0c-bd987c257c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:36.024624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a267f-fcc6-42c3-ac0c-bd987c257c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:36.026251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-718a267f-fcc6-42c3-ac0c-bd987c257c55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:36.053302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:36.134887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a267f-fcc6-42c3-ac0c-bd987c257c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:36.136262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a267f-fcc6-42c3-ac0c-bd987c257c55 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:36.153955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 666/1334] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:38.343374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73788f7-7758-426b-8a9d-d5101b1021fd None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:38.343933 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73788f7-7758-426b-8a9d-d5101b1021fd None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:38.343933 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73788f7-7758-426b-8a9d-d5101b1021fd None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:38.345291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 669/1335] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:38.350655 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b56c76-c082-4981-8e4b-e55cb8181ed4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:38.351082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b56c76-c082-4981-8e4b-e55cb8181ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:38.351220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b56c76-c082-4981-8e4b-e55cb8181ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:38.415069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d6b56c76-c082-4981-8e4b-e55cb8181ed4 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:38.416275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d6b56c76-c082-4981-8e4b-e55cb8181ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:38.490751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:38.514750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 667/1336] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:38.554855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73788f7-7758-426b-8a9d-d5101b1021fd None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:38.556367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c73788f7-7758-426b-8a9d-d5101b1021fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:38.657883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73788f7-7758-426b-8a9d-d5101b1021fd None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:38.687739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:38.731821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b2d7d-b43e-4618-81e1-aa917ff71f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:38.732456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2d7d-b43e-4618-81e1-aa917ff71f7a service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:38.732736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2d7d-b43e-4618-81e1-aa917ff71f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:38.733010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2d7d-b43e-4618-81e1-aa917ff71f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:38.734658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-276b2d7d-b43e-4618-81e1-aa917ff71f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:38.842498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b2d7d-b43e-4618-81e1-aa917ff71f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:38.843919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b2d7d-b43e-4618-81e1-aa917ff71f7a service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:38.862514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 670/1337] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:41.348178 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf212f-2077-4ef7-955b-f82e0b62ca77 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:41.348737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf212f-2077-4ef7-955b-f82e0b62ca77 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:41.348844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf212f-2077-4ef7-955b-f82e0b62ca77 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:41.350152 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 668/1338] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:41.355386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468bcc3-4395-4bc8-969b-93f55b92b779 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:41.355788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468bcc3-4395-4bc8-969b-93f55b92b779 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:41.355955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468bcc3-4395-4bc8-969b-93f55b92b779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:41.419082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1468bcc3-4395-4bc8-969b-93f55b92b779 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:41.420280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1468bcc3-4395-4bc8-969b-93f55b92b779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:41.428824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:41.515332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 671/1339] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:41.551480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf212f-2077-4ef7-955b-f82e0b62ca77 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:41.553544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e1bf212f-2077-4ef7-955b-f82e0b62ca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:41.659055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf212f-2077-4ef7-955b-f82e0b62ca77 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:41.729453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3525b-366a-4df6-872e-e468369bcbc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:41.730092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3525b-366a-4df6-872e-e468369bcbc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:41.730395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3525b-366a-4df6-872e-e468369bcbc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:41.730676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3525b-366a-4df6-872e-e468369bcbc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:41.732289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-81b3525b-366a-4df6-872e-e468369bcbc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:41.766519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:41.838346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3525b-366a-4df6-872e-e468369bcbc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:41.839789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3525b-366a-4df6-872e-e468369bcbc3 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:41.857454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 669/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:45.931771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f01445-a85c-4242-b5ba-800ed4afc655 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:45.932305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f01445-a85c-4242-b5ba-800ed4afc655 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:45.932305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f01445-a85c-4242-b5ba-800ed4afc655 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:45.933708 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 672/1341] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:45.939028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e462-fbb0-4524-bc9a-33054143c609 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:45.939468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e462-fbb0-4524-bc9a-33054143c609 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:45.939597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e462-fbb0-4524-bc9a-33054143c609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:46.010748 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4854e462-fbb0-4524-bc9a-33054143c609 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:46.011892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4854e462-fbb0-4524-bc9a-33054143c609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:46.110858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:46.124612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 670/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:46.163801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f01445-a85c-4242-b5ba-800ed4afc655 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:46.166014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-27f01445-a85c-4242-b5ba-800ed4afc655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:46.276765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f01445-a85c-4242-b5ba-800ed4afc655 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:46.280275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e662f21-3016-4079-a247-59279751816e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:46.280915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e662f21-3016-4079-a247-59279751816e service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:46.281195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e662f21-3016-4079-a247-59279751816e service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:46.281467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e662f21-3016-4079-a247-59279751816e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:46.290572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e662f21-3016-4079-a247-59279751816e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:46.291982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e662f21-3016-4079-a247-59279751816e service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:46.301455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 673/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:48.976739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91061b37-500e-4648-9834-33642bb24c8e None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:48.977274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91061b37-500e-4648-9834-33642bb24c8e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:48.977386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91061b37-500e-4648-9834-33642bb24c8e None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:48.978780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 671/1344] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:48.984104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312717b-f67d-421f-bf85-94aab8f14669 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:48.984540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312717b-f67d-421f-bf85-94aab8f14669 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:48.984790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312717b-f67d-421f-bf85-94aab8f14669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:49.013094 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b312717b-f67d-421f-bf85-94aab8f14669 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:49.014340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b312717b-f67d-421f-bf85-94aab8f14669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:49.048734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:49.102221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 674/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:49.140295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91061b37-500e-4648-9834-33642bb24c8e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:49.151994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91061b37-500e-4648-9834-33642bb24c8e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:49.155529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bb8c4-0393-4fc6-a342-c9acc3085d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:49.156185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bb8c4-0393-4fc6-a342-c9acc3085d29 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:49.156475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bb8c4-0393-4fc6-a342-c9acc3085d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:49.156756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bb8c4-0393-4fc6-a342-c9acc3085d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:49.167491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bb8c4-0393-4fc6-a342-c9acc3085d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:49.168956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bb8c4-0393-4fc6-a342-c9acc3085d29 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:49.179941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 672/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:53.091064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083aae-1368-4126-897c-bf7f42150a91 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:53.091593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083aae-1368-4126-897c-bf7f42150a91 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:53.091683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083aae-1368-4126-897c-bf7f42150a91 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:53.092986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 675/1347] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:53.098192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91f5d-6e2a-4f6e-b7cc-69097175f3fc None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:53.098625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91f5d-6e2a-4f6e-b7cc-69097175f3fc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:53.098775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91f5d-6e2a-4f6e-b7cc-69097175f3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:53.116984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-12c91f5d-6e2a-4f6e-b7cc-69097175f3fc None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:53.118113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-12c91f5d-6e2a-4f6e-b7cc-69097175f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:53.125811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 673/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:24:53.165505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75083aae-1368-4126-897c-bf7f42150a91 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:24:53.176070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75083aae-1368-4126-897c-bf7f42150a91 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:24:53.180137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b9fcc-88ce-482d-95a8-5627228c1435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:24:53.180773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b9fcc-88ce-482d-95a8-5627228c1435 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:53.181061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b9fcc-88ce-482d-95a8-5627228c1435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:53.181339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b9fcc-88ce-482d-95a8-5627228c1435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:53.190371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b9fcc-88ce-482d-95a8-5627228c1435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:24:53.191820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b9fcc-88ce-482d-95a8-5627228c1435 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:24:53.201978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 676/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:24:58.172043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5b39c-53e0-4687-8599-5efe3b6b3252 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:58.172588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5b39c-53e0-4687-8599-5efe3b6b3252 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:58.178899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5b39c-53e0-4687-8599-5efe3b6b3252 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:58.180537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 674/1350] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:24:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:24:58.186034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7ac5e-49d6-4454-9fb7-e88356e7829b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:24:58.186879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7ac5e-49d6-4454-9fb7-e88356e7829b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:24:58.187291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7ac5e-49d6-4454-9fb7-e88356e7829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:24:58.290976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-26e7ac5e-49d6-4454-9fb7-e88356e7829b None None] MFA Rules not processed for user `06d6f1eebcfa48349613455eb5d2aaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:24:58.292562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-26e7ac5e-49d6-4454-9fb7-e88356e7829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:24:58.378248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 677/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:02.631787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ea5e5-9293-4167-ae3c-b94cd4a855ab None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:02.632348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ea5e5-9293-4167-ae3c-b94cd4a855ab None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:02.632348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ea5e5-9293-4167-ae3c-b94cd4a855ab None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:02.633706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 675/1352] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:02.639245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb1c7-dc11-4c72-91a2-d01fdbacb395 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:02.639659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb1c7-dc11-4c72-91a2-d01fdbacb395 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:02.639798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb1c7-dc11-4c72-91a2-d01fdbacb395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:02.659487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-34feb1c7-dc11-4c72-91a2-d01fdbacb395 None None] MFA Rules not processed for user `06d6f1eebcfa48349613455eb5d2aaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:02.661175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-34feb1c7-dc11-4c72-91a2-d01fdbacb395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:02.670450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 678/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:03.110830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=13 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:04.323511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5137da-7927-4234-b193-8fdaf88b0ed1 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:04.324181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5137da-7927-4234-b193-8fdaf88b0ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:04.324447 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5137da-7927-4234-b193-8fdaf88b0ed1 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:04.326042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 676/1354] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:25:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:04.331108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912950dd-7c85-4095-9175-e99fb2994b5b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:04.331503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912950dd-7c85-4095-9175-e99fb2994b5b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:04.331646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912950dd-7c85-4095-9175-e99fb2994b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:04.350038 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-912950dd-7c85-4095-9175-e99fb2994b5b None None] MFA Rules not processed for user `06d6f1eebcfa48349613455eb5d2aaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:04.351253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-912950dd-7c85-4095-9175-e99fb2994b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:04.359926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 679/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:25:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:25:07.731329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa8a04-047c-4911-9425-ddce6f2a0c1c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:07.732296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa8a04-047c-4911-9425-ddce6f2a0c1c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:07.732799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa8a04-047c-4911-9425-ddce6f2a0c1c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:07.735732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 677/1356] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:07.739859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780222c-ee9a-45c3-875d-8157ff58fa5b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:07.740338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780222c-ee9a-45c3-875d-8157ff58fa5b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:07.740433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780222c-ee9a-45c3-875d-8157ff58fa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:07.762620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8780222c-ee9a-45c3-875d-8157ff58fa5b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:07.764261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8780222c-ee9a-45c3-875d-8157ff58fa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:07.774516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 680/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:07.835969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc83dc-8aa3-430c-a773-17a57285091f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:07.836336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc83dc-8aa3-430c-a773-17a57285091f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:07.836692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc83dc-8aa3-430c-a773-17a57285091f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:07.838262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 678/1358] 10.222.0.44 () {54 vars in 961 bytes} [Fri Jun 24 10:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:07.844923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b42e0-ca82-4cab-856b-97fdd865bdae None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:07.845495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b42e0-ca82-4cab-856b-97fdd865bdae None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:07.845994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b42e0-ca82-4cab-856b-97fdd865bdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:07.898276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:07.907209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7e6b42e0-ca82-4cab-856b-97fdd865bdae None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:07.908489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7e6b42e0-ca82-4cab-856b-97fdd865bdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:07.993541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 681/1359] 10.222.0.44 () {58 vars in 1058 bytes} [Fri Jun 24 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:08.001959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc83dc-8aa3-430c-a773-17a57285091f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:08.018119 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc83dc-8aa3-430c-a773-17a57285091f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:08.024279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca23e08-bd41-4557-8979-7ca039417f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:08.024918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23e08-bd41-4557-8979-7ca039417f9f service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:08.025202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23e08-bd41-4557-8979-7ca039417f9f service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:08.025480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23e08-bd41-4557-8979-7ca039417f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:08.036724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca23e08-bd41-4557-8979-7ca039417f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:08.039202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca23e08-bd41-4557-8979-7ca039417f9f service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:08.049540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 679/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:10.306386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c123e2-f521-4793-b613-502071a616e3 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:10.306934 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c123e2-f521-4793-b613-502071a616e3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:10.306934 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c123e2-f521-4793-b613-502071a616e3 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:10.308296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 682/1361] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:10.313677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c1bd-458c-4157-af77-5fe61c137768 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:10.314091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c1bd-458c-4157-af77-5fe61c137768 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:10.314229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c1bd-458c-4157-af77-5fe61c137768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:10.335092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5963c1bd-458c-4157-af77-5fe61c137768 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:10.336286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5963c1bd-458c-4157-af77-5fe61c137768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:10.344295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 680/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:10.388267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c123e2-f521-4793-b613-502071a616e3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:10.403241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c123e2-f521-4793-b613-502071a616e3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:10.409490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80bcc-73d0-4700-aa97-82a3979f6670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:10.410390 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80bcc-73d0-4700-aa97-82a3979f6670 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:10.410680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80bcc-73d0-4700-aa97-82a3979f6670 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:10.410950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80bcc-73d0-4700-aa97-82a3979f6670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:10.419771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80bcc-73d0-4700-aa97-82a3979f6670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:10.421347 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80bcc-73d0-4700-aa97-82a3979f6670 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:10.431782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 683/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:12.785706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd01c2-dfb4-4139-abe7-3ab1b237e9aa None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:12.786334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd01c2-dfb4-4139-abe7-3ab1b237e9aa None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:12.786334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd01c2-dfb4-4139-abe7-3ab1b237e9aa None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:12.787854 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 681/1364] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:12.792936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a65f4-078b-45eb-a077-dc213c98b735 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:12.793695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a65f4-078b-45eb-a077-dc213c98b735 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:12.794131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a65f4-078b-45eb-a077-dc213c98b735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:12.812921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-de1a65f4-078b-45eb-a077-dc213c98b735 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:12.829826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-de1a65f4-078b-45eb-a077-dc213c98b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:12.850400 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 684/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:12.889357 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6486c5b-4e68-4672-829b-d03f3cf0f656 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:12.889647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6486c5b-4e68-4672-829b-d03f3cf0f656 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:12.889926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6486c5b-4e68-4672-829b-d03f3cf0f656 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:12.891326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 682/1366] 10.222.0.44 () {54 vars in 961 bytes} [Fri Jun 24 10:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:12.897249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67a69-cd3e-4cc8-b0be-66e2a6f977d1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:12.897535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67a69-cd3e-4cc8-b0be-66e2a6f977d1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:12.897811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67a69-cd3e-4cc8-b0be-66e2a6f977d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:12.916269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c0b67a69-cd3e-4cc8-b0be-66e2a6f977d1 None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:12.917442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c0b67a69-cd3e-4cc8-b0be-66e2a6f977d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:12.926674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 685/1367] 10.222.0.44 () {58 vars in 1058 bytes} [Fri Jun 24 10:25:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:12.933971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6486c5b-4e68-4672-829b-d03f3cf0f656 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:12.947874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6486c5b-4e68-4672-829b-d03f3cf0f656 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:12.953086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d4653-b424-42ad-8d54-ea8983cedf05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:12.953706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d4653-b424-42ad-8d54-ea8983cedf05 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:12.953987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d4653-b424-42ad-8d54-ea8983cedf05 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:12.954259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d4653-b424-42ad-8d54-ea8983cedf05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:12.962922 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d4653-b424-42ad-8d54-ea8983cedf05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:12.964544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d4653-b424-42ad-8d54-ea8983cedf05 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:12.974661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 683/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:15.063384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0496d-1eff-48eb-9103-e7b63b5929ce None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:15.063917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0496d-1eff-48eb-9103-e7b63b5929ce None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:15.064230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0496d-1eff-48eb-9103-e7b63b5929ce None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:15.066467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 686/1369] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:15.071847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dccd5f-751e-4dcc-a4f0-acaefd7efb28 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:15.072257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dccd5f-751e-4dcc-a4f0-acaefd7efb28 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:15.072451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dccd5f-751e-4dcc-a4f0-acaefd7efb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:15.090761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-78dccd5f-751e-4dcc-a4f0-acaefd7efb28 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:15.091960 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-78dccd5f-751e-4dcc-a4f0-acaefd7efb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:15.105448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 684/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:15.148275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0496d-1eff-48eb-9103-e7b63b5929ce None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:15.164321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0496d-1eff-48eb-9103-e7b63b5929ce None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:15.169952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9cd81-bd23-4995-bd64-03fd58ae745e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:15.170754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9cd81-bd23-4995-bd64-03fd58ae745e service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:15.171314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9cd81-bd23-4995-bd64-03fd58ae745e service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:15.171649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9cd81-bd23-4995-bd64-03fd58ae745e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:15.181848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9cd81-bd23-4995-bd64-03fd58ae745e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:15.183677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9cd81-bd23-4995-bd64-03fd58ae745e service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:15.194186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 687/1371] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:15.836236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc0a0-e479-440a-ac0d-27a199bc71e0 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:15.836665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc0a0-e479-440a-ac0d-27a199bc71e0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:15.837189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc0a0-e479-440a-ac0d-27a199bc71e0 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:15.838762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 685/1372] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:15.844029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a59ff-2e3f-41c1-a367-d9c34256b0c0 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:15.844317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a59ff-2e3f-41c1-a367-d9c34256b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:15.844593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a59ff-2e3f-41c1-a367-d9c34256b0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:15.863105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6a1a59ff-2e3f-41c1-a367-d9c34256b0c0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:15.864298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6a1a59ff-2e3f-41c1-a367-d9c34256b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:15.872238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 688/1373] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:16.194752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437794e-c30f-43f6-aa6e-d3a63aa0cb5f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:16.195169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437794e-c30f-43f6-aa6e-d3a63aa0cb5f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:16.195552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437794e-c30f-43f6-aa6e-d3a63aa0cb5f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:16.197387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 686/1374] 10.222.0.44 () {54 vars in 963 bytes} [Fri Jun 24 10:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:16.202560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bce62-0d30-425d-bccd-aa265c64548d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:16.203369 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bce62-0d30-425d-bccd-aa265c64548d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:16.203811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bce62-0d30-425d-bccd-aa265c64548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:16.257455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-342bce62-0d30-425d-bccd-aa265c64548d None None] MFA Rules not processed for user `a9cffe87117f447dacec4289f454a8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:16.258789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-342bce62-0d30-425d-bccd-aa265c64548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:16.324651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 689/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Fri Jun 24 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:16.333818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437794e-c30f-43f6-aa6e-d3a63aa0cb5f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:16.344858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437794e-c30f-43f6-aa6e-d3a63aa0cb5f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:16.348795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a57f0-66e4-4bd6-9aaf-1a5d92a26a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:16.349505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a57f0-66e4-4bd6-9aaf-1a5d92a26a94 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:16.349857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a57f0-66e4-4bd6-9aaf-1a5d92a26a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:16.350392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a57f0-66e4-4bd6-9aaf-1a5d92a26a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:16.359941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a57f0-66e4-4bd6-9aaf-1a5d92a26a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:16.361467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a57f0-66e4-4bd6-9aaf-1a5d92a26a94 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:16.371436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 687/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:17.279116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8d4c-9765-4e5d-857c-ee7f90ea1152 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:17.279623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8d4c-9765-4e5d-857c-ee7f90ea1152 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:17.279812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8d4c-9765-4e5d-857c-ee7f90ea1152 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:17.282319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 690/1377] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:17.287221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800be98-dc41-432c-9c25-0cdb54a51b13 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:17.288145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800be98-dc41-432c-9c25-0cdb54a51b13 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:17.288511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800be98-dc41-432c-9c25-0cdb54a51b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:17.312877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7800be98-dc41-432c-9c25-0cdb54a51b13 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:17.314248 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7800be98-dc41-432c-9c25-0cdb54a51b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:17.323274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 688/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:17.368051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a8d4c-9765-4e5d-857c-ee7f90ea1152 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:17.382405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a8d4c-9765-4e5d-857c-ee7f90ea1152 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:17.387855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfa04d-97b9-454f-8fef-c42361f3cb16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:17.388491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfa04d-97b9-454f-8fef-c42361f3cb16 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:17.388779 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfa04d-97b9-454f-8fef-c42361f3cb16 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:17.389119 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfa04d-97b9-454f-8fef-c42361f3cb16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:17.397999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfa04d-97b9-454f-8fef-c42361f3cb16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:17.399611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfa04d-97b9-454f-8fef-c42361f3cb16 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:17.403580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:17.411297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 691/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:19.461759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836b615-3438-49c0-b1f5-e6581992a20d None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:19.462253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836b615-3438-49c0-b1f5-e6581992a20d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:19.462253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836b615-3438-49c0-b1f5-e6581992a20d None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:19.463733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 689/1380] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:19.469074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813108be-30b5-4330-a5a7-89fc134e341d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:19.469492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813108be-30b5-4330-a5a7-89fc134e341d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:19.469631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813108be-30b5-4330-a5a7-89fc134e341d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:19.488231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-813108be-30b5-4330-a5a7-89fc134e341d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:19.489413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-813108be-30b5-4330-a5a7-89fc134e341d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:19.497233 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 692/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:19.543028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836b615-3438-49c0-b1f5-e6581992a20d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:19.557112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836b615-3438-49c0-b1f5-e6581992a20d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:19.564831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c7642-7c9d-4d1f-b742-f2abb9b323dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:19.564831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c7642-7c9d-4d1f-b742-f2abb9b323dc service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:19.564831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c7642-7c9d-4d1f-b742-f2abb9b323dc service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:19.564831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c7642-7c9d-4d1f-b742-f2abb9b323dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:19.573636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c7642-7c9d-4d1f-b742-f2abb9b323dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:19.575389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c7642-7c9d-4d1f-b742-f2abb9b323dc service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:19.585237 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 690/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:21.679473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49855b24-24a4-45bf-9d5b-4a2f0218b8b9 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:21.679992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49855b24-24a4-45bf-9d5b-4a2f0218b8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:21.680072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49855b24-24a4-45bf-9d5b-4a2f0218b8b9 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:21.681397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 693/1383] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:21.686678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556b87-1392-4833-8376-fce1833cd80c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:21.687073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556b87-1392-4833-8376-fce1833cd80c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:21.687234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556b87-1392-4833-8376-fce1833cd80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:21.706314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-50556b87-1392-4833-8376-fce1833cd80c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:21.707554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-50556b87-1392-4833-8376-fce1833cd80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:21.715625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 691/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:21.757658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49855b24-24a4-45bf-9d5b-4a2f0218b8b9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:21.772816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49855b24-24a4-45bf-9d5b-4a2f0218b8b9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:21.778123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffb3b7-2f7c-4b87-8e5d-c299fae94a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:21.778792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffb3b7-2f7c-4b87-8e5d-c299fae94a1a service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:21.779080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffb3b7-2f7c-4b87-8e5d-c299fae94a1a service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:21.779359 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffb3b7-2f7c-4b87-8e5d-c299fae94a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:21.789037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffb3b7-2f7c-4b87-8e5d-c299fae94a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:21.790629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffb3b7-2f7c-4b87-8e5d-c299fae94a1a service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:21.800396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 694/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:23.901823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ac7c-4c8d-4cc8-a10e-8601fa0045c6 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:23.902276 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ac7c-4c8d-4cc8-a10e-8601fa0045c6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:23.902496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369ac7c-4c8d-4cc8-a10e-8601fa0045c6 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:23.903993 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 692/1386] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:23.910377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41777dcc-ff4d-4d7b-a603-c962ed8a3721 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:23.911005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41777dcc-ff4d-4d7b-a603-c962ed8a3721 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:23.911005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41777dcc-ff4d-4d7b-a603-c962ed8a3721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:23.932922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-41777dcc-ff4d-4d7b-a603-c962ed8a3721 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:23.934129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-41777dcc-ff4d-4d7b-a603-c962ed8a3721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:23.942955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 695/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:23.991414 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369ac7c-4c8d-4cc8-a10e-8601fa0045c6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:24.007115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369ac7c-4c8d-4cc8-a10e-8601fa0045c6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:24.012636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63181146-17e7-484c-a336-e964fa5878a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:24.013277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63181146-17e7-484c-a336-e964fa5878a3 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:24.013573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63181146-17e7-484c-a336-e964fa5878a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:24.013849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63181146-17e7-484c-a336-e964fa5878a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:24.022280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63181146-17e7-484c-a336-e964fa5878a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:24.023887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63181146-17e7-484c-a336-e964fa5878a3 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:24.033529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 693/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:26.120562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd8a1-668b-4cd7-9b3d-ef3b0340a1df None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:26.121123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd8a1-668b-4cd7-9b3d-ef3b0340a1df None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:26.121123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd8a1-668b-4cd7-9b3d-ef3b0340a1df None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:26.122567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 696/1389] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:26.128856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e0ce1-060b-4413-a8e0-ca15acbc1334 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:26.129298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e0ce1-060b-4413-a8e0-ca15acbc1334 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:26.129645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e0ce1-060b-4413-a8e0-ca15acbc1334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:26.152562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-647e0ce1-060b-4413-a8e0-ca15acbc1334 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:26.154154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-647e0ce1-060b-4413-a8e0-ca15acbc1334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:26.165033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 694/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:26.211479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bd8a1-668b-4cd7-9b3d-ef3b0340a1df None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:26.226531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bd8a1-668b-4cd7-9b3d-ef3b0340a1df None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:26.233226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c583-12fd-4f55-8653-286d56e8ad41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:26.233864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c583-12fd-4f55-8653-286d56e8ad41 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:26.234154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c583-12fd-4f55-8653-286d56e8ad41 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:26.234467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c583-12fd-4f55-8653-286d56e8ad41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:26.243725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2c583-12fd-4f55-8653-286d56e8ad41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:26.245306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2c583-12fd-4f55-8653-286d56e8ad41 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:26.255643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 697/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:28.371593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5c41-98ae-4008-94d8-186111cce791 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:28.372159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5c41-98ae-4008-94d8-186111cce791 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:28.372159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5c41-98ae-4008-94d8-186111cce791 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:28.373521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 695/1392] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:28.379920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50113c1-5455-419b-9fff-6de0c35a4353 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:28.380373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50113c1-5455-419b-9fff-6de0c35a4353 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:28.380673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50113c1-5455-419b-9fff-6de0c35a4353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:28.402851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a50113c1-5455-419b-9fff-6de0c35a4353 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:28.404137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a50113c1-5455-419b-9fff-6de0c35a4353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:28.412437 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 698/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:28.457402 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5c41-98ae-4008-94d8-186111cce791 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:28.475935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5c41-98ae-4008-94d8-186111cce791 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:28.483058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b93e-375f-4966-853b-f532b5ac043f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:28.484103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b93e-375f-4966-853b-f532b5ac043f service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:28.484739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b93e-375f-4966-853b-f532b5ac043f service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:28.485110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b93e-375f-4966-853b-f532b5ac043f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:28.498865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b93e-375f-4966-853b-f532b5ac043f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:28.504349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b93e-375f-4966-853b-f532b5ac043f service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:28.531106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 696/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:30.672232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c778a-d887-4d4f-9f6a-5d67fd5ddc1b None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:30.672822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c778a-d887-4d4f-9f6a-5d67fd5ddc1b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:30.672822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c778a-d887-4d4f-9f6a-5d67fd5ddc1b None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:30.674711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 699/1395] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:30.679833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55d731-16ad-423d-8bc4-78f9d75e705e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:30.680298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55d731-16ad-423d-8bc4-78f9d75e705e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:30.680398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55d731-16ad-423d-8bc4-78f9d75e705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:30.699456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ad55d731-16ad-423d-8bc4-78f9d75e705e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:30.700700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ad55d731-16ad-423d-8bc4-78f9d75e705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:30.708739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 697/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:30.752884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c778a-d887-4d4f-9f6a-5d67fd5ddc1b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:30.767062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c778a-d887-4d4f-9f6a-5d67fd5ddc1b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:30.772909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745187e-dff9-4a75-81d4-6a4e78938266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:30.773545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745187e-dff9-4a75-81d4-6a4e78938266 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:30.773830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745187e-dff9-4a75-81d4-6a4e78938266 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:30.774107 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745187e-dff9-4a75-81d4-6a4e78938266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:30.782234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745187e-dff9-4a75-81d4-6a4e78938266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:30.784691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745187e-dff9-4a75-81d4-6a4e78938266 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:30.794558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 700/1397] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:31.621744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f450bb-bb04-4c08-846b-af18dfed9d2f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:31.622032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f450bb-bb04-4c08-846b-af18dfed9d2f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:31.622309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f450bb-bb04-4c08-846b-af18dfed9d2f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:31.623720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 698/1398] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:31.629463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f91c08-3ac9-4a6c-b5f7-750d47bf7fd8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:31.629760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f91c08-3ac9-4a6c-b5f7-750d47bf7fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:31.630048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f91c08-3ac9-4a6c-b5f7-750d47bf7fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:31.647862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-18f91c08-3ac9-4a6c-b5f7-750d47bf7fd8 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:31.649070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-18f91c08-3ac9-4a6c-b5f7-750d47bf7fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:31.656867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 701/1399] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:31.711665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd4758-fe62-43eb-a7f1-457eafb71eef None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:31.712123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd4758-fe62-43eb-a7f1-457eafb71eef None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:31.712432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd4758-fe62-43eb-a7f1-457eafb71eef None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:31.713858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 699/1400] 10.222.0.44 () {54 vars in 962 bytes} [Fri Jun 24 10:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:31.718850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b6703-a5c5-427c-900d-ec9d4bab9458 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:31.719265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b6703-a5c5-427c-900d-ec9d4bab9458 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:31.719420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b6703-a5c5-427c-900d-ec9d4bab9458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:31.767868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4e5b6703-a5c5-427c-900d-ec9d4bab9458 None None] MFA Rules not processed for user `2fe27c3402a741f0a80d87ae6ecd3f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:31.769045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4e5b6703-a5c5-427c-900d-ec9d4bab9458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:31.828136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 702/1401] 10.222.0.44 () {58 vars in 1059 bytes} [Fri Jun 24 10:25:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:31.835649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd4758-fe62-43eb-a7f1-457eafb71eef None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:31.846735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd4758-fe62-43eb-a7f1-457eafb71eef None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:31.850651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acf3c9-41a4-4ddc-b297-77e301d63ccc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe27c3402a741f0a80d87ae6ecd3f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:31.851355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf3c9-41a4-4ddc-b297-77e301d63ccc service glance] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:31.851704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf3c9-41a4-4ddc-b297-77e301d63ccc service glance] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:31.852071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf3c9-41a4-4ddc-b297-77e301d63ccc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:31.861405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acf3c9-41a4-4ddc-b297-77e301d63ccc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:31.863493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acf3c9-41a4-4ddc-b297-77e301d63ccc service glance] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:31.872993 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 700/1402] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:25:32.595372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721a563-5f32-44d0-aa13-84651913c444 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:32.595954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721a563-5f32-44d0-aa13-84651913c444 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:32.596330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721a563-5f32-44d0-aa13-84651913c444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:32.644154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0721a563-5f32-44d0-aa13-84651913c444 None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:32.645352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0721a563-5f32-44d0-aa13-84651913c444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:32.692634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:32.717414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 703/1403] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:32.759975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e029943-7b92-4cf2-a3cc-d72c9f670bd2 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:32.760437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e029943-7b92-4cf2-a3cc-d72c9f670bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:32.760541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e029943-7b92-4cf2-a3cc-d72c9f670bd2 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:32.761936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 701/1404] 10.222.0.44 () {54 vars in 942 bytes} [Fri Jun 24 10:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:32.768825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180519-9af8-40cb-a9ac-66f30945d7b3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:32.769273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180519-9af8-40cb-a9ac-66f30945d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:32.769509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180519-9af8-40cb-a9ac-66f30945d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:32.817125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-67180519-9af8-40cb-a9ac-66f30945d7b3 None None] MFA Rules not processed for user `67ae1a0fbb4f44e6b60281ce63dc68fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:32.818324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-67180519-9af8-40cb-a9ac-66f30945d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:32.852776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859032cd-2e52-4d82-b998-253837e8eced None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:32.853103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859032cd-2e52-4d82-b998-253837e8eced None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:32.853392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859032cd-2e52-4d82-b998-253837e8eced None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:32.854841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 702/1405] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:25:32.860188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138ab66-6ce0-483c-8dd1-5b9e850359f0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:32.860586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138ab66-6ce0-483c-8dd1-5b9e850359f0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:32.860930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138ab66-6ce0-483c-8dd1-5b9e850359f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:32.879923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c138ab66-6ce0-483c-8dd1-5b9e850359f0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:32.881215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c138ab66-6ce0-483c-8dd1-5b9e850359f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:32.889406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 703/1406] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:25:32.893558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 704/1407] 10.222.0.44 () {58 vars in 1039 bytes} [Fri Jun 24 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:25:32.902763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138ab66-6ce0-483c-8dd1-5b9e850359f0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:32.914278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138ab66-6ce0-483c-8dd1-5b9e850359f0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:32.919678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2439-c347-4d5c-b200-7f87e72771ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:32.920445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2439-c347-4d5c-b200-7f87e72771ce service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:32.920730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2439-c347-4d5c-b200-7f87e72771ce service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:32.921011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2439-c347-4d5c-b200-7f87e72771ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:32.930499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2439-c347-4d5c-b200-7f87e72771ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:32.932132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2439-c347-4d5c-b200-7f87e72771ce service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:32.934765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67180519-9af8-40cb-a9ac-66f30945d7b3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:32.941091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 704/1408] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:25:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 10:25:32.947617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67180519-9af8-40cb-a9ac-66f30945d7b3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:32.955817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b48df2-75e7-4763-a5e4-934f6dfd58b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:32.956620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b48df2-75e7-4763-a5e4-934f6dfd58b7 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:32.956762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b48df2-75e7-4763-a5e4-934f6dfd58b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:32.957019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b48df2-75e7-4763-a5e4-934f6dfd58b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:32.966044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b48df2-75e7-4763-a5e4-934f6dfd58b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:32.967770 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b48df2-75e7-4763-a5e4-934f6dfd58b7 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:32.978031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 705/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:25:42.937189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=69 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:42.973196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=59 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:54.888820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c8ce-adeb-45e9-a01a-5a6e47932e69 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:54.889389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c8ce-adeb-45e9-a01a-5a6e47932e69 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:54.889389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c8ce-adeb-45e9-a01a-5a6e47932e69 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:54.890703 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 705/1410] 10.222.0.44 () {54 vars in 918 bytes} [Fri Jun 24 10:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:54.895717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a7052-465a-4eba-bde5-fe2026e80d0f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:54.896165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a7052-465a-4eba-bde5-fe2026e80d0f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:54.896314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a7052-465a-4eba-bde5-fe2026e80d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:54.914206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f26a7052-465a-4eba-bde5-fe2026e80d0f None None] MFA Rules not processed for user `06d6f1eebcfa48349613455eb5d2aaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:54.915421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f26a7052-465a-4eba-bde5-fe2026e80d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:54.923801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 706/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Fri Jun 24 10:25:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:54.938274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3ee26-e3a1-4b35-9205-5e8637b9d77e None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:54.938602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3ee26-e3a1-4b35-9205-5e8637b9d77e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:54.938888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3ee26-e3a1-4b35-9205-5e8637b9d77e None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:54.940262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 706/1412] 10.222.0.44 () {54 vars in 918 bytes} [Fri Jun 24 10:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:54.945354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca82b7-b941-4dc4-ae57-c13b7cbd5719 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:54.945640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca82b7-b941-4dc4-ae57-c13b7cbd5719 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:54.945916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca82b7-b941-4dc4-ae57-c13b7cbd5719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:54.963161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5dca82b7-b941-4dc4-ae57-c13b7cbd5719 None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:54.964342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5dca82b7-b941-4dc4-ae57-c13b7cbd5719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:54.973351 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 707/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Fri Jun 24 10:25:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:25:57.480106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957305-d452-4e9d-8497-7ab9626d688b None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:57.480627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957305-d452-4e9d-8497-7ab9626d688b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:57.480747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957305-d452-4e9d-8497-7ab9626d688b None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:57.482028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:57.487149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73a62-8ae2-4178-bf15-98393c91e13e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:57.487533 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73a62-8ae2-4178-bf15-98393c91e13e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:57.487715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73a62-8ae2-4178-bf15-98393c91e13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:57.505600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3ff73a62-8ae2-4178-bf15-98393c91e13e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:57.506833 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3ff73a62-8ae2-4178-bf15-98393c91e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:57.514595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:57.557809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4957305-d452-4e9d-8497-7ab9626d688b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:57.573456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4957305-d452-4e9d-8497-7ab9626d688b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:57.578707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc968a-df41-4395-8259-3290dcc7cf7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:57.579342 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc968a-df41-4395-8259-3290dcc7cf7f service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:57.579623 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc968a-df41-4395-8259-3290dcc7cf7f service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:57.579900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc968a-df41-4395-8259-3290dcc7cf7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:57.588521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc968a-df41-4395-8259-3290dcc7cf7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:57.590081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc968a-df41-4395-8259-3290dcc7cf7f service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:57.599803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 708/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:58.487888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df0ac-a4ad-4482-8a57-12e8b1b326bc None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:58.488453 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df0ac-a4ad-4482-8a57-12e8b1b326bc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:58.488453 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56df0ac-a4ad-4482-8a57-12e8b1b326bc None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:58.490323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:58.495242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92dbc9-6e03-46fe-b5bc-b3b4759df394 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:58.495673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92dbc9-6e03-46fe-b5bc-b3b4759df394 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:58.495788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92dbc9-6e03-46fe-b5bc-b3b4759df394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:58.514204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1c92dbc9-6e03-46fe-b5bc-b3b4759df394 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:58.515417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1c92dbc9-6e03-46fe-b5bc-b3b4759df394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:58.523380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:58.672484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56df0ac-a4ad-4482-8a57-12e8b1b326bc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:58.686636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56df0ac-a4ad-4482-8a57-12e8b1b326bc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:58.691951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb4f32-9548-4727-a828-29264c71e03e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:58.692583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb4f32-9548-4727-a828-29264c71e03e service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:58.692870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb4f32-9548-4727-a828-29264c71e03e service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:58.693150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb4f32-9548-4727-a828-29264c71e03e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:58.701598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb4f32-9548-4727-a828-29264c71e03e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:58.703210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb4f32-9548-4727-a828-29264c71e03e service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:58.713150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 710/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:25:59.579326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ef89-4c4f-467e-b946-c9fb83271800 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:59.579725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ef89-4c4f-467e-b946-c9fb83271800 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:59.579883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ef89-4c4f-467e-b946-c9fb83271800 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:59.581260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:25:59.586389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc26b-a178-4c08-b880-db7f88c83d7a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:59.586800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc26b-a178-4c08-b880-db7f88c83d7a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:59.586987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc26b-a178-4c08-b880-db7f88c83d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:59.605185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-602cc26b-a178-4c08-b880-db7f88c83d7a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:25:59.606408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-602cc26b-a178-4c08-b880-db7f88c83d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:25:59.614084 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:25:59.768424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06ef89-4c4f-467e-b946-c9fb83271800 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:25:59.782908 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06ef89-4c4f-467e-b946-c9fb83271800 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:25:59.788938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c96b89-39ad-491d-96df-d1685319b559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:25:59.789553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c96b89-39ad-491d-96df-d1685319b559 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:25:59.789833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c96b89-39ad-491d-96df-d1685319b559 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:25:59.790106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c96b89-39ad-491d-96df-d1685319b559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:25:59.798143 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c96b89-39ad-491d-96df-d1685319b559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:25:59.799736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c96b89-39ad-491d-96df-d1685319b559 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:25:59.809433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 711/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:00.673033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670edb3-77e9-499b-9b84-adf0f13b9156 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:00.673580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670edb3-77e9-499b-9b84-adf0f13b9156 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:00.673580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670edb3-77e9-499b-9b84-adf0f13b9156 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:00.675005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:00.680429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82d47a-d71a-4c5c-8de8-56fb0be54432 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:00.680833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82d47a-d71a-4c5c-8de8-56fb0be54432 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:00.680995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82d47a-d71a-4c5c-8de8-56fb0be54432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:00.699077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5c82d47a-d71a-4c5c-8de8-56fb0be54432 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:00.700274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5c82d47a-d71a-4c5c-8de8-56fb0be54432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:00.707933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:00.858827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670edb3-77e9-499b-9b84-adf0f13b9156 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:00.873168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670edb3-77e9-499b-9b84-adf0f13b9156 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:00.878551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a382f-6f86-40bb-a87a-df2f9d01d3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:00.879181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a382f-6f86-40bb-a87a-df2f9d01d3b8 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:00.879470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a382f-6f86-40bb-a87a-df2f9d01d3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:00.879753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a382f-6f86-40bb-a87a-df2f9d01d3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:00.887809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a382f-6f86-40bb-a87a-df2f9d01d3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:00.889385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a382f-6f86-40bb-a87a-df2f9d01d3b8 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:00.899268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 713/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:01.746898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423488b-e8ec-4354-bd7a-de1634224e58 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:01.747460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423488b-e8ec-4354-bd7a-de1634224e58 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:01.747460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423488b-e8ec-4354-bd7a-de1634224e58 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:01.748848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:01.753644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9468271-ea93-4e87-b4a7-dffae91a8f1a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:01.754114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9468271-ea93-4e87-b4a7-dffae91a8f1a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:01.754220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9468271-ea93-4e87-b4a7-dffae91a8f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:01.773321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a9468271-ea93-4e87-b4a7-dffae91a8f1a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:01.774644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a9468271-ea93-4e87-b4a7-dffae91a8f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:01.782333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:01.931433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423488b-e8ec-4354-bd7a-de1634224e58 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:01.946110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423488b-e8ec-4354-bd7a-de1634224e58 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:01.951395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf661450-d47f-499d-ad9e-24fcd2b5b0d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:01.952031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf661450-d47f-499d-ad9e-24fcd2b5b0d7 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:01.952317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf661450-d47f-499d-ad9e-24fcd2b5b0d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:01.952595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf661450-d47f-499d-ad9e-24fcd2b5b0d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:01.961583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf661450-d47f-499d-ad9e-24fcd2b5b0d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:01.963182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf661450-d47f-499d-ad9e-24fcd2b5b0d7 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:01.972446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 714/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:02.771186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539a5d7-bfa0-4f09-9ee2-aa0d45e7d540 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:02.771722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539a5d7-bfa0-4f09-9ee2-aa0d45e7d540 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:02.771722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539a5d7-bfa0-4f09-9ee2-aa0d45e7d540 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:02.773706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:02.778531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec28526-bfb6-4996-aa91-de3114a85a39 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:02.778931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec28526-bfb6-4996-aa91-de3114a85a39 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:02.779088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec28526-bfb6-4996-aa91-de3114a85a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:02.797081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5ec28526-bfb6-4996-aa91-de3114a85a39 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:02.798279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5ec28526-bfb6-4996-aa91-de3114a85a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:02.805974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:02.956226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539a5d7-bfa0-4f09-9ee2-aa0d45e7d540 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:02.970265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539a5d7-bfa0-4f09-9ee2-aa0d45e7d540 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:02.975614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcad4ed-ecf0-49d3-9263-ba2b8566c365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:02.976231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcad4ed-ecf0-49d3-9263-ba2b8566c365 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:02.976514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcad4ed-ecf0-49d3-9263-ba2b8566c365 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:02.976791 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcad4ed-ecf0-49d3-9263-ba2b8566c365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:02.984821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcad4ed-ecf0-49d3-9263-ba2b8566c365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:02.986413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcad4ed-ecf0-49d3-9263-ba2b8566c365 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:02.996097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 716/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:03.810854 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878ffc2-2890-4176-b955-51cc7717521c None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:03.811486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878ffc2-2890-4176-b955-51cc7717521c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:03.811486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878ffc2-2890-4176-b955-51cc7717521c None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:03.812847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:03.817923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9082a7d-d5af-467b-ab50-a425391aff0c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:03.818298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9082a7d-d5af-467b-ab50-a425391aff0c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:03.818527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9082a7d-d5af-467b-ab50-a425391aff0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:03.836824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c9082a7d-d5af-467b-ab50-a425391aff0c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:03.837996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c9082a7d-d5af-467b-ab50-a425391aff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:03.845714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:04.001231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878ffc2-2890-4176-b955-51cc7717521c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:04.016049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878ffc2-2890-4176-b955-51cc7717521c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:04.021398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba3d5d-7444-4f5e-9638-8e0e09493d5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:04.022030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba3d5d-7444-4f5e-9638-8e0e09493d5a service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:04.022318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba3d5d-7444-4f5e-9638-8e0e09493d5a service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:04.022627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba3d5d-7444-4f5e-9638-8e0e09493d5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:04.030623 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba3d5d-7444-4f5e-9638-8e0e09493d5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:04.032209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba3d5d-7444-4f5e-9638-8e0e09493d5a service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:04.042259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 717/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:04.840320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ad349-c0e0-477e-9951-c2c613742992 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:04.840956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ad349-c0e0-477e-9951-c2c613742992 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:04.840956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ad349-c0e0-477e-9951-c2c613742992 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:04.842288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:04.847153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bfb44-598d-4dc7-b8a5-e28c912d6f12 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:04.847621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bfb44-598d-4dc7-b8a5-e28c912d6f12 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:04.847731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bfb44-598d-4dc7-b8a5-e28c912d6f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:04.865460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-086bfb44-598d-4dc7-b8a5-e28c912d6f12 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:04.866730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-086bfb44-598d-4dc7-b8a5-e28c912d6f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:04.874554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:05.026428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ad349-c0e0-477e-9951-c2c613742992 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:05.041161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ad349-c0e0-477e-9951-c2c613742992 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:05.046484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d186f-f2a5-4624-86cc-791174bbe0ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:05.047114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d186f-f2a5-4624-86cc-791174bbe0ae service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:05.047396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d186f-f2a5-4624-86cc-791174bbe0ae service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:05.047668 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d186f-f2a5-4624-86cc-791174bbe0ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:05.055664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d186f-f2a5-4624-86cc-791174bbe0ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:05.057230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d186f-f2a5-4624-86cc-791174bbe0ae service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:05.066423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 719/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:05.871996 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545b859-47f6-4660-b35e-3b25b9e716e7 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:05.872508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545b859-47f6-4660-b35e-3b25b9e716e7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:05.872508 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545b859-47f6-4660-b35e-3b25b9e716e7 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:05.873866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:05.878777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b8732-2aa5-4ac6-8a3b-c8d5aa4951ac None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:05.879196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b8732-2aa5-4ac6-8a3b-c8d5aa4951ac None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:05.879349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b8732-2aa5-4ac6-8a3b-c8d5aa4951ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:05.897456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-596b8732-2aa5-4ac6-8a3b-c8d5aa4951ac None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:05.898722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-596b8732-2aa5-4ac6-8a3b-c8d5aa4951ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:05.906891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:26:06.059039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545b859-47f6-4660-b35e-3b25b9e716e7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:06.073763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545b859-47f6-4660-b35e-3b25b9e716e7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:06.079201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554efc9-f179-4a0c-8cc0-e6866f3ecf7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:06.079825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554efc9-f179-4a0c-8cc0-e6866f3ecf7a service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:06.080106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554efc9-f179-4a0c-8cc0-e6866f3ecf7a service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:06.080381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554efc9-f179-4a0c-8cc0-e6866f3ecf7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:06.088373 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554efc9-f179-4a0c-8cc0-e6866f3ecf7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:06.089942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554efc9-f179-4a0c-8cc0-e6866f3ecf7a service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:06.099146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 720/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:08.016672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5421e-9e26-4449-86fe-3ce50d4d3868 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:08.017213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5421e-9e26-4449-86fe-3ce50d4d3868 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:08.017213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5421e-9e26-4449-86fe-3ce50d4d3868 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:08.018576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:08.023625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e7861-ef69-4aaf-9e02-631913375a5f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:08.024037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e7861-ef69-4aaf-9e02-631913375a5f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:08.024817 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e7861-ef69-4aaf-9e02-631913375a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:08.042990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2a2e7861-ef69-4aaf-9e02-631913375a5f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:08.044171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2a2e7861-ef69-4aaf-9e02-631913375a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:08.051827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:08.090294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5421e-9e26-4449-86fe-3ce50d4d3868 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:08.100733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5421e-9e26-4449-86fe-3ce50d4d3868 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:08.104731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b792bf-c4fa-45b3-9896-b3e6bf0ba5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:08.105350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b792bf-c4fa-45b3-9896-b3e6bf0ba5cf service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:08.105628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b792bf-c4fa-45b3-9896-b3e6bf0ba5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:08.105900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b792bf-c4fa-45b3-9896-b3e6bf0ba5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:08.114554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b792bf-c4fa-45b3-9896-b3e6bf0ba5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:08.115962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b792bf-c4fa-45b3-9896-b3e6bf0ba5cf service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:08.125668 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 722/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:26:10.392366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec528-f58e-44aa-997a-cd188ae5dc29 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:10.392927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec528-f58e-44aa-997a-cd188ae5dc29 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:10.392927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ec528-f58e-44aa-997a-cd188ae5dc29 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:10.394304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:10.399718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68e0b3-e678-4697-8726-9e858d21a00a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:10.400189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68e0b3-e678-4697-8726-9e858d21a00a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:10.400843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68e0b3-e678-4697-8726-9e858d21a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:10.418312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5b68e0b3-e678-4697-8726-9e858d21a00a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:10.419524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5b68e0b3-e678-4697-8726-9e858d21a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:10.427177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:10.465914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec528-f58e-44aa-997a-cd188ae5dc29 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:10.476375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ec528-f58e-44aa-997a-cd188ae5dc29 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:10.480457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0266ef-7886-4265-946e-4dd43ae59797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:10.481083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0266ef-7886-4265-946e-4dd43ae59797 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:10.481366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0266ef-7886-4265-946e-4dd43ae59797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:10.481637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0266ef-7886-4265-946e-4dd43ae59797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:10.490696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0266ef-7886-4265-946e-4dd43ae59797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:10.492112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0266ef-7886-4265-946e-4dd43ae59797 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:10.501347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 723/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:12.854233 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788da5f-da63-4ebb-a556-0b1e691b3ba1 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:12.855323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788da5f-da63-4ebb-a556-0b1e691b3ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:12.855323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788da5f-da63-4ebb-a556-0b1e691b3ba1 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:12.856724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:12.862003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc71a-25ca-4b13-8664-af2c4225b0a0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:12.862447 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc71a-25ca-4b13-8664-af2c4225b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:12.862592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc71a-25ca-4b13-8664-af2c4225b0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:12.879812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0e0bc71a-25ca-4b13-8664-af2c4225b0a0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:12.880994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0e0bc71a-25ca-4b13-8664-af2c4225b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:12.888642 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:12.927569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788da5f-da63-4ebb-a556-0b1e691b3ba1 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:12.938597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788da5f-da63-4ebb-a556-0b1e691b3ba1 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:12.942048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624ec1f-98ad-41b2-96dd-9b7f78e1768a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:12.942709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624ec1f-98ad-41b2-96dd-9b7f78e1768a service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:12.942998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624ec1f-98ad-41b2-96dd-9b7f78e1768a service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:12.943273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624ec1f-98ad-41b2-96dd-9b7f78e1768a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:12.952454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624ec1f-98ad-41b2-96dd-9b7f78e1768a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:12.953872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624ec1f-98ad-41b2-96dd-9b7f78e1768a service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:12.963113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 725/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:15.106314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094eb94-daed-4ca6-9f82-235243fabfe1 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:15.106861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094eb94-daed-4ca6-9f82-235243fabfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:15.106975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094eb94-daed-4ca6-9f82-235243fabfe1 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:15.108345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:15.113553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54ca14-0b39-4517-871e-1b1b32ed181b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:15.113979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54ca14-0b39-4517-871e-1b1b32ed181b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:15.114163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54ca14-0b39-4517-871e-1b1b32ed181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:15.131836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5e54ca14-0b39-4517-871e-1b1b32ed181b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:15.133015 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5e54ca14-0b39-4517-871e-1b1b32ed181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:15.141343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:15.179662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094eb94-daed-4ca6-9f82-235243fabfe1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:15.190565 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094eb94-daed-4ca6-9f82-235243fabfe1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:15.193966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4e6f3-6d33-4768-a7ea-800ca09fa8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:15.194616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4e6f3-6d33-4768-a7ea-800ca09fa8ce service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:15.194901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4e6f3-6d33-4768-a7ea-800ca09fa8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:15.195175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4e6f3-6d33-4768-a7ea-800ca09fa8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:15.204739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4e6f3-6d33-4768-a7ea-800ca09fa8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:15.206149 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4e6f3-6d33-4768-a7ea-800ca09fa8ce service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:15.215426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 726/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:17.314201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a4482-51a5-4451-bb48-4d22c922d3ad None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:17.314763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a4482-51a5-4451-bb48-4d22c922d3ad None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:17.314888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a4482-51a5-4451-bb48-4d22c922d3ad None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:17.316188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:17.321479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b041d-be30-4d11-99cb-630ba7c47729 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:17.321888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b041d-be30-4d11-99cb-630ba7c47729 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:17.322031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b041d-be30-4d11-99cb-630ba7c47729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:17.339913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a66b041d-be30-4d11-99cb-630ba7c47729 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:17.341617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a66b041d-be30-4d11-99cb-630ba7c47729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:17.349236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:17.386793 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a4482-51a5-4451-bb48-4d22c922d3ad None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:17.397581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a4482-51a5-4451-bb48-4d22c922d3ad None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:17.401399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5a1a1-e466-4ad0-b0e5-017ed3037747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:17.402034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5a1a1-e466-4ad0-b0e5-017ed3037747 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:17.402315 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5a1a1-e466-4ad0-b0e5-017ed3037747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:17.402617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5a1a1-e466-4ad0-b0e5-017ed3037747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:17.412547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5a1a1-e466-4ad0-b0e5-017ed3037747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:17.413964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5a1a1-e466-4ad0-b0e5-017ed3037747 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:17.424152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 728/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:19.508837 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3223a5-2cce-4415-bf8e-70ad77c24bde None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:19.509416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3223a5-2cce-4415-bf8e-70ad77c24bde None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:19.509416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3223a5-2cce-4415-bf8e-70ad77c24bde None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:19.510813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:19.516511 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27d8b-e362-475c-b5f4-7622e886c35c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:19.516923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27d8b-e362-475c-b5f4-7622e886c35c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:19.517205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27d8b-e362-475c-b5f4-7622e886c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:19.535061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-89a27d8b-e362-475c-b5f4-7622e886c35c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:19.536259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-89a27d8b-e362-475c-b5f4-7622e886c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:19.544029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:19.583337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3223a5-2cce-4415-bf8e-70ad77c24bde None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:19.594089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3223a5-2cce-4415-bf8e-70ad77c24bde None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:19.597583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7aa99f-54d5-40e6-9116-9deb456b22ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:19.598211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7aa99f-54d5-40e6-9116-9deb456b22ac service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:19.598520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7aa99f-54d5-40e6-9116-9deb456b22ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:19.598795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7aa99f-54d5-40e6-9116-9deb456b22ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:19.607483 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7aa99f-54d5-40e6-9116-9deb456b22ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:19.608903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7aa99f-54d5-40e6-9116-9deb456b22ac service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:19.618064 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 729/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:21.695693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ee70-1f72-47a5-9c89-54aadec4a27a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:21.696227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ee70-1f72-47a5-9c89-54aadec4a27a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:21.696227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ee70-1f72-47a5-9c89-54aadec4a27a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:21.697606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:21.703335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51e873-7b4a-4ac8-a026-ece8fb2bb7c6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:21.703782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51e873-7b4a-4ac8-a026-ece8fb2bb7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:21.703903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51e873-7b4a-4ac8-a026-ece8fb2bb7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:21.721191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-8d51e873-7b4a-4ac8-a026-ece8fb2bb7c6 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:21.722429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8d51e873-7b4a-4ac8-a026-ece8fb2bb7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:21.730222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:21.767989 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ee70-1f72-47a5-9c89-54aadec4a27a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:21.778607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ee70-1f72-47a5-9c89-54aadec4a27a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:21.782102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798f97c-bce4-4d26-8052-80a33d9ef9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:21.782771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798f97c-bce4-4d26-8052-80a33d9ef9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:21.783056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798f97c-bce4-4d26-8052-80a33d9ef9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:21.783337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798f97c-bce4-4d26-8052-80a33d9ef9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:21.792219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798f97c-bce4-4d26-8052-80a33d9ef9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:21.793636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798f97c-bce4-4d26-8052-80a33d9ef9f5 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:21.803331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 731/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:23.844276 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26379112-060f-4e57-8696-2c30d09804de None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:23.844807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26379112-060f-4e57-8696-2c30d09804de None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:23.844807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26379112-060f-4e57-8696-2c30d09804de None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:23.846295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:23.851587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f7c54-7dea-4b0b-8afd-e3697ff3b2bb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:23.851999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f7c54-7dea-4b0b-8afd-e3697ff3b2bb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:23.852161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f7c54-7dea-4b0b-8afd-e3697ff3b2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:23.858768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=79 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:23.871226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-411f7c54-7dea-4b0b-8afd-e3697ff3b2bb None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:23.872436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-411f7c54-7dea-4b0b-8afd-e3697ff3b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:23.880956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:23.918838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26379112-060f-4e57-8696-2c30d09804de None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:23.925108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=73 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:23.931452 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26379112-060f-4e57-8696-2c30d09804de None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:23.934874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfc42b-58be-4dc3-a56d-cb78806bbeee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:23.935498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfc42b-58be-4dc3-a56d-cb78806bbeee service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:23.935777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfc42b-58be-4dc3-a56d-cb78806bbeee service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:23.936047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfc42b-58be-4dc3-a56d-cb78806bbeee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:23.944719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfc42b-58be-4dc3-a56d-cb78806bbeee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:23.946132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfc42b-58be-4dc3-a56d-cb78806bbeee service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:23.955617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 732/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:25.972577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5f176-eced-45db-bd47-abe703970714 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:25.973106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5f176-eced-45db-bd47-abe703970714 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:25.973106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5f176-eced-45db-bd47-abe703970714 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:25.974452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:25.979767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b5eb2-3758-4f5e-9715-896c1c408a9c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:25.980180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b5eb2-3758-4f5e-9715-896c1c408a9c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:25.980322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b5eb2-3758-4f5e-9715-896c1c408a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:25.997661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ef7b5eb2-3758-4f5e-9715-896c1c408a9c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:25.998922 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ef7b5eb2-3758-4f5e-9715-896c1c408a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:26.006603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:26.043374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5f176-eced-45db-bd47-abe703970714 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:26.054477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5f176-eced-45db-bd47-abe703970714 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:26.057931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7b206-3390-4f13-b463-9e7fadf73ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:26.058597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b206-3390-4f13-b463-9e7fadf73ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:26.058883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b206-3390-4f13-b463-9e7fadf73ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:26.059164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b206-3390-4f13-b463-9e7fadf73ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:26.068003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7b206-3390-4f13-b463-9e7fadf73ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:26.069414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7b206-3390-4f13-b463-9e7fadf73ef3 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:26.079198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 734/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:28.099394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d351-18a5-46a5-b2a1-1f4820882d55 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:28.099984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d351-18a5-46a5-b2a1-1f4820882d55 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:28.099984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d351-18a5-46a5-b2a1-1f4820882d55 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:28.101331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:28.106652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce062e-b70d-49cb-8ad5-9ab9b2e39b1b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:28.107108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce062e-b70d-49cb-8ad5-9ab9b2e39b1b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:28.107216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce062e-b70d-49cb-8ad5-9ab9b2e39b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:28.124904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e1ce062e-b70d-49cb-8ad5-9ab9b2e39b1b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:28.126721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e1ce062e-b70d-49cb-8ad5-9ab9b2e39b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:28.134299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:28.171189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d351-18a5-46a5-b2a1-1f4820882d55 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:28.182417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d351-18a5-46a5-b2a1-1f4820882d55 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:28.185873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ad24f-3422-4ab4-a53d-3317a99ce430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:28.186543 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad24f-3422-4ab4-a53d-3317a99ce430 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:28.186826 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad24f-3422-4ab4-a53d-3317a99ce430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:28.187101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad24f-3422-4ab4-a53d-3317a99ce430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:28.196809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ad24f-3422-4ab4-a53d-3317a99ce430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:28.198227 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ad24f-3422-4ab4-a53d-3317a99ce430 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:28.207583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 735/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:38.119917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=11 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:38.203357 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=14 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:48.029844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b1d89-3c74-40f9-a37c-a80b7ab6335a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:48.030422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b1d89-3c74-40f9-a37c-a80b7ab6335a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:48.030422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b1d89-3c74-40f9-a37c-a80b7ab6335a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:48.031792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 736/1471] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:48.037268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb548c6-03ae-4c2f-9f5a-c923a1b0b449 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:48.037696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb548c6-03ae-4c2f-9f5a-c923a1b0b449 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:48.037825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb548c6-03ae-4c2f-9f5a-c923a1b0b449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:48.055180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1eb548c6-03ae-4c2f-9f5a-c923a1b0b449 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:48.056633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1eb548c6-03ae-4c2f-9f5a-c923a1b0b449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:48.064232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 736/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:48.111121 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd153-5286-4eee-8a60-e9f658d46cd1 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:48.111410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd153-5286-4eee-8a60-e9f658d46cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:48.111686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd153-5286-4eee-8a60-e9f658d46cd1 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:48.113030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 737/1473] 10.222.0.44 () {54 vars in 962 bytes} [Fri Jun 24 10:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:48.117878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ad4b-b602-4ee2-b238-5db325b74416 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:48.118170 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ad4b-b602-4ee2-b238-5db325b74416 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:48.118486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ad4b-b602-4ee2-b238-5db325b74416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:48.137084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d9c2ad4b-b602-4ee2-b238-5db325b74416 None None] MFA Rules not processed for user `2fe27c3402a741f0a80d87ae6ecd3f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:48.138313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d9c2ad4b-b602-4ee2-b238-5db325b74416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:48.144768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 737/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Fri Jun 24 10:26:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:48.152405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dd153-5286-4eee-8a60-e9f658d46cd1 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:48.162709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dd153-5286-4eee-8a60-e9f658d46cd1 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:48.166131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb570-394d-4dbf-ac3d-9779f5582ffa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe27c3402a741f0a80d87ae6ecd3f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:48.166772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb570-394d-4dbf-ac3d-9779f5582ffa service glance] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:48.167056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb570-394d-4dbf-ac3d-9779f5582ffa service glance] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:48.167329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb570-394d-4dbf-ac3d-9779f5582ffa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:48.175996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb570-394d-4dbf-ac3d-9779f5582ffa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:48.177397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb570-394d-4dbf-ac3d-9779f5582ffa service glance] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:48.186850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 738/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:26:50.316790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680339-6971-4a55-a96e-a85fdeca389e None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:50.317360 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680339-6971-4a55-a96e-a85fdeca389e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:50.317360 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680339-6971-4a55-a96e-a85fdeca389e None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:50.318757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 738/1476] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:50.324358 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23175df4-2f56-4854-b071-156187d52b90 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:50.324750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23175df4-2f56-4854-b071-156187d52b90 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:50.324921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23175df4-2f56-4854-b071-156187d52b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:50.343411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-23175df4-2f56-4854-b071-156187d52b90 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:50.344612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-23175df4-2f56-4854-b071-156187d52b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:50.352375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 739/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:50.375172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b680339-6971-4a55-a96e-a85fdeca389e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:50.388363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b680339-6971-4a55-a96e-a85fdeca389e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:50.392815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b062f4-9739-4640-bcf2-e7de9b14812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:50.393460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b062f4-9739-4640-bcf2-e7de9b14812f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:50.393747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b062f4-9739-4640-bcf2-e7de9b14812f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:50.394022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b062f4-9739-4640-bcf2-e7de9b14812f admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:50.394788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b062f4-9739-4640-bcf2-e7de9b14812f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:50.396545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-e3b062f4-9739-4640-bcf2-e7de9b14812f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:26:50.396545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: warnings.warn(msg) Jun 24 10:26:50.396545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: Jun 24 10:26:50.397687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b062f4-9739-4640-bcf2-e7de9b14812f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:50.416955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 739/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Jun 24 10:26:50 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:26:52.436853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34d14-3baf-4753-a5fb-c6c5259761f7 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:52.437425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34d14-3baf-4753-a5fb-c6c5259761f7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:52.437425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f34d14-3baf-4753-a5fb-c6c5259761f7 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:52.438859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 740/1479] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:52.443865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca283-65ed-49c9-9f15-bf54d22db1e8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:52.444297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca283-65ed-49c9-9f15-bf54d22db1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:52.444405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca283-65ed-49c9-9f15-bf54d22db1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:52.462766 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-036ca283-65ed-49c9-9f15-bf54d22db1e8 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:52.463962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-036ca283-65ed-49c9-9f15-bf54d22db1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:52.471607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 740/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:52.513620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f34d14-3baf-4753-a5fb-c6c5259761f7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:52.528313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f34d14-3baf-4753-a5fb-c6c5259761f7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:52.533620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0268d1-fc25-4bab-a4ab-b85c2a75bc4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:52.534245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0268d1-fc25-4bab-a4ab-b85c2a75bc4d service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:52.534562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0268d1-fc25-4bab-a4ab-b85c2a75bc4d service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:52.534842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0268d1-fc25-4bab-a4ab-b85c2a75bc4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:52.542880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0268d1-fc25-4bab-a4ab-b85c2a75bc4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:52.544458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0268d1-fc25-4bab-a4ab-b85c2a75bc4d service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:52.554119 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 741/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:54.749521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fda3b5-3459-43d2-bf70-0394d92a6b48 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:54.750067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fda3b5-3459-43d2-bf70-0394d92a6b48 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:54.750162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fda3b5-3459-43d2-bf70-0394d92a6b48 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:54.751567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 741/1482] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:54.756608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09fb21-34f7-41d9-8c9c-da57d0afdcff None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:54.757038 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09fb21-34f7-41d9-8c9c-da57d0afdcff None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:54.757193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09fb21-34f7-41d9-8c9c-da57d0afdcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:54.774947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6d09fb21-34f7-41d9-8c9c-da57d0afdcff None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:54.776990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6d09fb21-34f7-41d9-8c9c-da57d0afdcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:54.784868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 742/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:54.820634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fda3b5-3459-43d2-bf70-0394d92a6b48 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:54.831755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fda3b5-3459-43d2-bf70-0394d92a6b48 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:54.835363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80226f-14e2-4ff2-811a-264bc2d71472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:54.836001 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80226f-14e2-4ff2-811a-264bc2d71472 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:54.836284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80226f-14e2-4ff2-811a-264bc2d71472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:54.836585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80226f-14e2-4ff2-811a-264bc2d71472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:54.846224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80226f-14e2-4ff2-811a-264bc2d71472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:54.847690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80226f-14e2-4ff2-811a-264bc2d71472 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:54.858514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 742/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:26:56.955872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09818f99-a2d0-45f4-8a9b-29b8a6f7fca8 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:56.956366 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09818f99-a2d0-45f4-8a9b-29b8a6f7fca8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:56.956475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09818f99-a2d0-45f4-8a9b-29b8a6f7fca8 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:56.957811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 743/1485] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:56.962900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f3dd4-974f-40e1-a87d-cca89acb796d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:56.963317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f3dd4-974f-40e1-a87d-cca89acb796d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:56.963499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f3dd4-974f-40e1-a87d-cca89acb796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:56.981241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-589f3dd4-974f-40e1-a87d-cca89acb796d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:56.982473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-589f3dd4-974f-40e1-a87d-cca89acb796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:56.990138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 743/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:57.027407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09818f99-a2d0-45f4-8a9b-29b8a6f7fca8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:57.037940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09818f99-a2d0-45f4-8a9b-29b8a6f7fca8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:57.042484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea28a0a-c1de-4e7c-8e8a-646c3fc7a8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:57.043125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea28a0a-c1de-4e7c-8e8a-646c3fc7a8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:57.043411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea28a0a-c1de-4e7c-8e8a-646c3fc7a8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:57.043691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea28a0a-c1de-4e7c-8e8a-646c3fc7a8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:57.052706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea28a0a-c1de-4e7c-8e8a-646c3fc7a8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:57.054075 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea28a0a-c1de-4e7c-8e8a-646c3fc7a8d5 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:57.064419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 744/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:26:59.181759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd76c-425a-40fd-b815-b4a3853aeea1 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:59.182326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd76c-425a-40fd-b815-b4a3853aeea1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:59.182326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd76c-425a-40fd-b815-b4a3853aeea1 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:59.183734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 744/1488] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:26:59.189091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ad096-eb3b-42b5-8ef1-89025bad45ed None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:59.189522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ad096-eb3b-42b5-8ef1-89025bad45ed None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:59.189679 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ad096-eb3b-42b5-8ef1-89025bad45ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:59.207456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-512ad096-eb3b-42b5-8ef1-89025bad45ed None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:26:59.208663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-512ad096-eb3b-42b5-8ef1-89025bad45ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:26:59.216916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 745/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:26:59.257549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd76c-425a-40fd-b815-b4a3853aeea1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:26:59.269140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd76c-425a-40fd-b815-b4a3853aeea1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:26:59.272626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc32a3-720d-4dc9-a69a-70f2e4b03882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:26:59.273260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc32a3-720d-4dc9-a69a-70f2e4b03882 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:26:59.273547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc32a3-720d-4dc9-a69a-70f2e4b03882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:26:59.273827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc32a3-720d-4dc9-a69a-70f2e4b03882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:26:59.283480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc32a3-720d-4dc9-a69a-70f2e4b03882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:26:59.284914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc32a3-720d-4dc9-a69a-70f2e4b03882 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:26:59.294860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 745/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:27:01.503000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c470-9c29-4fd3-a893-ccb3490118da None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:27:01.503545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c470-9c29-4fd3-a893-ccb3490118da None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:27:01.503545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c470-9c29-4fd3-a893-ccb3490118da None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:27:01.504938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 746/1491] 10.222.0.44 () {54 vars in 926 bytes} [Fri Jun 24 10:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:27:01.510173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128310-bb20-4e51-a72d-7d0dfaec4f9e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:27:01.510650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128310-bb20-4e51-a72d-7d0dfaec4f9e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:27:01.510758 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128310-bb20-4e51-a72d-7d0dfaec4f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:27:01.527975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ba128310-bb20-4e51-a72d-7d0dfaec4f9e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:27:01.529156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ba128310-bb20-4e51-a72d-7d0dfaec4f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:27:01.536736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 746/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Fri Jun 24 10:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:27:01.576638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6c470-9c29-4fd3-a893-ccb3490118da None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:27:01.578321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1ff6c470-9c29-4fd3-a893-ccb3490118da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:27:01.591064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6c470-9c29-4fd3-a893-ccb3490118da None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:27:01.594493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc7e17-766b-4a55-95e8-906d37681963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:27:01.595116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc7e17-766b-4a55-95e8-906d37681963 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:27:01.595399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc7e17-766b-4a55-95e8-906d37681963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:27:01.595674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc7e17-766b-4a55-95e8-906d37681963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:27:01.604958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc7e17-766b-4a55-95e8-906d37681963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:27:01.606418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc7e17-766b-4a55-95e8-906d37681963 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:27:01.615605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 747/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:27:11.522988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=33 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:27:11.611558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=33 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:27.564296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf308d-82e2-4061-b328-22354006be56 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:27.564897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf308d-82e2-4061-b328-22354006be56 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:27.564897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf308d-82e2-4061-b328-22354006be56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:27.582888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-21bf308d-82e2-4061-b328-22354006be56 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:28:27.584092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-21bf308d-82e2-4061-b328-22354006be56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:28:27.593117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 747/1494] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:28:27.602310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67147e8-f42d-4ebc-ab78-d7625c8da268 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:27.602848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67147e8-f42d-4ebc-ab78-d7625c8da268 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:27.602954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67147e8-f42d-4ebc-ab78-d7625c8da268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:27.621686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d67147e8-f42d-4ebc-ab78-d7625c8da268 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:28:27.622911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d67147e8-f42d-4ebc-ab78-d7625c8da268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:28:27.630659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 748/1495] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:28:27.635204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf308d-82e2-4061-b328-22354006be56 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:28:27.644874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf308d-82e2-4061-b328-22354006be56 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:28:27.649375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e514-bb01-479f-b5ed-46771f30aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:28:27.650025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e514-bb01-479f-b5ed-46771f30aa3b admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:27.650311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e514-bb01-479f-b5ed-46771f30aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:27.650644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e514-bb01-479f-b5ed-46771f30aa3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:27.651386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45e514-bb01-479f-b5ed-46771f30aa3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:28:27.651694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45e514-bb01-479f-b5ed-46771f30aa3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:28:27.652785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-4e45e514-bb01-479f-b5ed-46771f30aa3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:27.652785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: warnings.warn(msg) Jun 24 10:28:27.652785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: Jun 24 10:28:27.653693 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45e514-bb01-479f-b5ed-46771f30aa3b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:28:27.665397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 748/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:28:27.673851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67147e8-f42d-4ebc-ab78-d7625c8da268 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:28:27.682962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67147e8-f42d-4ebc-ab78-d7625c8da268 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:28:27.688091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd056c9a-910d-4211-a121-dda5c42f9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:28:27.688731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd056c9a-910d-4211-a121-dda5c42f9f34 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:27.689018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd056c9a-910d-4211-a121-dda5c42f9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:27.689298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd056c9a-910d-4211-a121-dda5c42f9f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:27.689985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd056c9a-910d-4211-a121-dda5c42f9f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:28:27.691782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-bd056c9a-910d-4211-a121-dda5c42f9f34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:27.691782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: warnings.warn(msg) Jun 24 10:28:27.691782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: Jun 24 10:28:27.692976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd056c9a-910d-4211-a121-dda5c42f9f34 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:28:27.728396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 749/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:28:27 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:28:27.733116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e514-bb01-479f-b5ed-46771f30aa3b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:28:27.743148 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e514-bb01-479f-b5ed-46771f30aa3b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:28:27.799751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83fc82-c7a3-495e-b4eb-9405411586f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:28:27.800410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83fc82-c7a3-495e-b4eb-9405411586f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:27.800699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83fc82-c7a3-495e-b4eb-9405411586f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:27.800980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83fc82-c7a3-495e-b4eb-9405411586f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:27.801706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83fc82-c7a3-495e-b4eb-9405411586f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:28:27.802737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-1c83fc82-c7a3-495e-b4eb-9405411586f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:27.802737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: warnings.warn(msg) Jun 24 10:28:27.802737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: Jun 24 10:28:27.803957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83fc82-c7a3-495e-b4eb-9405411586f2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:28:27.822896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 749/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:28:27 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:28:27.827466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd056c9a-910d-4211-a121-dda5c42f9f34 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:28:27.837637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd056c9a-910d-4211-a121-dda5c42f9f34 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:28:27.843158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b410f-03e1-4c14-8c2d-bae3b4451bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:28:27.843811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b410f-03e1-4c14-8c2d-bae3b4451bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:27.844091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b410f-03e1-4c14-8c2d-bae3b4451bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:27.844368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b410f-03e1-4c14-8c2d-bae3b4451bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:27.845094 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b410f-03e1-4c14-8c2d-bae3b4451bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:28:27.846088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-1a2b410f-03e1-4c14-8c2d-bae3b4451bcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:27.846088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: warnings.warn(msg) Jun 24 10:28:27.846088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: Jun 24 10:28:27.847014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b410f-03e1-4c14-8c2d-bae3b4451bcd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:28:27.859466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 750/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:28:27.863305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83fc82-c7a3-495e-b4eb-9405411586f2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:28:27.873120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83fc82-c7a3-495e-b4eb-9405411586f2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:28:27.877560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce1c3b-5394-4333-9527-4335192da101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:28:27.878207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1c3b-5394-4333-9527-4335192da101 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:27.878528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1c3b-5394-4333-9527-4335192da101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:27.878818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1c3b-5394-4333-9527-4335192da101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:27.879525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1c3b-5394-4333-9527-4335192da101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:28:27.880525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-1cce1c3b-5394-4333-9527-4335192da101 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:27.880525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: warnings.warn(msg) Jun 24 10:28:27.880525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: Jun 24 10:28:27.881398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1c3b-5394-4333-9527-4335192da101 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:28:27.895406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 750/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:28:27.899567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b410f-03e1-4c14-8c2d-bae3b4451bcd admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:28:27.910913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b410f-03e1-4c14-8c2d-bae3b4451bcd admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:28:27.915618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e80e9-9cde-4446-aa7f-98860c6bbfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:28:27.916514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e80e9-9cde-4446-aa7f-98860c6bbfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:27.916800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e80e9-9cde-4446-aa7f-98860c6bbfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:27.917076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e80e9-9cde-4446-aa7f-98860c6bbfb8 admin admin] PATH_INFO: `/v3/projects/4470a538a69e41f5b9b6d556226a5eca/users/1dca0353cbb342b2b944bcbab7069563/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:27.936727 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e80e9-9cde-4446-aa7f-98860c6bbfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4470a538a69e41f5b9b6d556226a5eca, user_id=1dca0353cbb342b2b944bcbab7069563, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:28:27.937759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-319e80e9-9cde-4446-aa7f-98860c6bbfb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:27.937759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: warnings.warn(msg) Jun 24 10:28:27.937759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: Jun 24 10:28:27.939736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e80e9-9cde-4446-aa7f-98860c6bbfb8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:28:27.953147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 751/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:28:27 2022] PUT /identity/v3/projects/4470a538a69e41f5b9b6d556226a5eca/users/1dca0353cbb342b2b944bcbab7069563/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:28:27.964430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e9b6e-9490-4498-a576-fc77c3422e65 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:27.964746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e9b6e-9490-4498-a576-fc77c3422e65 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:27.965022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e9b6e-9490-4498-a576-fc77c3422e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:27.990719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fe5e9b6e-9490-4498-a576-fc77c3422e65 None None] MFA Rules not processed for user `1dca0353cbb342b2b944bcbab7069563`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:28:27.991919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fe5e9b6e-9490-4498-a576-fc77c3422e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:28:28.053252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 751/1502] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:28:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:28:28.066691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab76ff-e8f1-4822-b478-0a6c9a3cfb2a None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:28.066980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab76ff-e8f1-4822-b478-0a6c9a3cfb2a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:28.067258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab76ff-e8f1-4822-b478-0a6c9a3cfb2a None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:28.068642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 752/1503] 10.222.0.44 () {54 vars in 963 bytes} [Fri Jun 24 10:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:28:28.073500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af47b3b-1ca0-462e-a090-849664909f7f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:28.073732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af47b3b-1ca0-462e-a090-849664909f7f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:28.074074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af47b3b-1ca0-462e-a090-849664909f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:28.092481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1af47b3b-1ca0-462e-a090-849664909f7f None None] MFA Rules not processed for user `a9cffe87117f447dacec4289f454a8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:28:28.093653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1af47b3b-1ca0-462e-a090-849664909f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:28:28.135585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:28.148211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 752/1504] 10.222.0.44 () {58 vars in 1060 bytes} [Fri Jun 24 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:28:28.156228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab76ff-e8f1-4822-b478-0a6c9a3cfb2a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:28:28.166709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab76ff-e8f1-4822-b478-0a6c9a3cfb2a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:28:28.170510 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148fec3-85cc-4949-bfd4-01dc3cd9f6ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:28:28.171132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fec3-85cc-4949-bfd4-01dc3cd9f6ac service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:28.171414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fec3-85cc-4949-bfd4-01dc3cd9f6ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:28.171690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fec3-85cc-4949-bfd4-01dc3cd9f6ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:28.179760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148fec3-85cc-4949-bfd4-01dc3cd9f6ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:28:28.181176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148fec3-85cc-4949-bfd4-01dc3cd9f6ac service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:28:28.190391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 753/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:28:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:28:28.232054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbf58c-dd2b-479b-8fa0-15f2e960d15e None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:28.232352 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbf58c-dd2b-479b-8fa0-15f2e960d15e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:28.232637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbf58c-dd2b-479b-8fa0-15f2e960d15e None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:28.233943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 753/1506] 10.222.0.44 () {52 vars in 829 bytes} [Fri Jun 24 10:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:28:28.237490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148fec3-85cc-4949-bfd4-01dc3cd9f6ac service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:28:28.300375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148fec3-85cc-4949-bfd4-01dc3cd9f6ac service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:28:28.304900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:28:28.305761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:28.306043 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:28.306319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] PATH_INFO: `/v3/users/1dca0353cbb342b2b944bcbab7069563` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:28.307518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dca0353cbb342b2b944bcbab7069563)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:28:28.309079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:28.309079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: warnings.warn(msg) Jun 24 10:28:28.309079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: Jun 24 10:28:28.310276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:28:28.379129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dca0353cbb342b2b944bcbab7069563'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:28:28.379812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dca0353cbb342b2b944bcbab7069563'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:28:28.380443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dca0353cbb342b2b944bcbab7069563'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:28:28.398564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dca0353cbb342b2b944bcbab7069563'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:28:28.410441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dca0353cbb342b2b944bcbab7069563'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:28:28.414321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:28.427550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 754/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:28:28 2022] DELETE /identity/v3/users/1dca0353cbb342b2b944bcbab7069563 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:28:28.431916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b869a7-19b6-4325-b48e-297a7d8b5529 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:28.432220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b869a7-19b6-4325-b48e-297a7d8b5529 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:28.432503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b869a7-19b6-4325-b48e-297a7d8b5529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:28.450184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-26b869a7-19b6-4325-b48e-297a7d8b5529 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:28:28.451421 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-26b869a7-19b6-4325-b48e-297a7d8b5529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:28:28.508637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 754/1508] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:28:28.517950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:28:28.519409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:28:28.576053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82382c-7e01-4f73-b6f6-e038b9a6fb84 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:28:28.579587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18cce5-835a-4092-b659-484d475445de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:28:28.580225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18cce5-835a-4092-b659-484d475445de service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:28.580507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18cce5-835a-4092-b659-484d475445de service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:28.580784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18cce5-835a-4092-b659-484d475445de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:28.589450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18cce5-835a-4092-b659-484d475445de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:28:28.591290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18cce5-835a-4092-b659-484d475445de service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:28:28.600493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 755/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:28:28.932178 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b869a7-19b6-4325-b48e-297a7d8b5529 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:28:28.933854 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-26b869a7-19b6-4325-b48e-297a7d8b5529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:28:28.948336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b869a7-19b6-4325-b48e-297a7d8b5529 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:28:28.953223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:28:28.954083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:28:28.954382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:28:28.954656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] PATH_INFO: `/v3/projects/4470a538a69e41f5b9b6d556226a5eca` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:28:28.955826 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4470a538a69e41f5b9b6d556226a5eca)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:28:28.956855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:28:28.956855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: warnings.warn(msg) Jun 24 10:28:28.956855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: Jun 24 10:28:28.958052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:28:29.018709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4470a538a69e41f5b9b6d556226a5eca', 'request_id': 'req-a34c7524-8963-499e-a92e-ba901490fd69'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:28:29.028398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4470a538a69e41f5b9b6d556226a5eca', 'request_id': 'req-a34c7524-8963-499e-a92e-ba901490fd69'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:28:29.034467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4470a538a69e41f5b9b6d556226a5eca', 'request_id': 'req-a34c7524-8963-499e-a92e-ba901490fd69'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:28:29.052187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] The token cache is being invalidate because project 4470a538a69e41f5b9b6d556226a5eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:28:29.052476 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:28:29.053132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a34c7524-8963-499e-a92e-ba901490fd69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:28:29.054782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 755/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:28:28 2022] DELETE /identity/v3/projects/4470a538a69e41f5b9b6d556226a5eca => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:28:38.596366 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:39.049286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:30:13.145687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762b82f-125f-4a4d-9b8e-2666daf7572d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:13.146333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762b82f-125f-4a4d-9b8e-2666daf7572d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:13.146333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762b82f-125f-4a4d-9b8e-2666daf7572d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:13.147650 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:30:13.152657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d2f08-5e33-435e-bc2e-73aa7083359f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:13.153148 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d2f08-5e33-435e-bc2e-73aa7083359f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:13.153250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d2f08-5e33-435e-bc2e-73aa7083359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:13.171821 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-444d2f08-5e33-435e-bc2e-73aa7083359f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:30:13.173013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-444d2f08-5e33-435e-bc2e-73aa7083359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:13.233816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:30:13.388436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762b82f-125f-4a4d-9b8e-2666daf7572d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:30:13.390137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7762b82f-125f-4a4d-9b8e-2666daf7572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:13.463957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762b82f-125f-4a4d-9b8e-2666daf7572d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:30:13.469338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce1e8a-d5c8-404d-a9e7-595528a1a432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:30:13.469983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce1e8a-d5c8-404d-a9e7-595528a1a432 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:13.470266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce1e8a-d5c8-404d-a9e7-595528a1a432 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:13.470659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce1e8a-d5c8-404d-a9e7-595528a1a432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:13.479950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce1e8a-d5c8-404d-a9e7-595528a1a432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:30:13.481537 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce1e8a-d5c8-404d-a9e7-595528a1a432 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:30:13.490908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 757/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:30:14.316286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e46c8-bbe1-4ab8-9680-c065dc8ecb7e None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:14.316848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e46c8-bbe1-4ab8-9680-c065dc8ecb7e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:14.316848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e46c8-bbe1-4ab8-9680-c065dc8ecb7e None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:14.318374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:30:14.323676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cacc2f-905d-4ede-9f30-9d4fb9d654a4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:14.324126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cacc2f-905d-4ede-9f30-9d4fb9d654a4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:14.324235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cacc2f-905d-4ede-9f30-9d4fb9d654a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:14.341824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-91cacc2f-905d-4ede-9f30-9d4fb9d654a4 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:30:14.343060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-91cacc2f-905d-4ede-9f30-9d4fb9d654a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:14.350677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:30:14.504226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e46c8-bbe1-4ab8-9680-c065dc8ecb7e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:30:14.522602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e46c8-bbe1-4ab8-9680-c065dc8ecb7e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:30:14.529547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba6425-c130-4b68-bdbc-302a6c33a024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:30:14.530199 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba6425-c130-4b68-bdbc-302a6c33a024 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:14.530522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba6425-c130-4b68-bdbc-302a6c33a024 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:14.530803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba6425-c130-4b68-bdbc-302a6c33a024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:14.541692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba6425-c130-4b68-bdbc-302a6c33a024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:30:14.544145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba6425-c130-4b68-bdbc-302a6c33a024 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:30:14.554544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 758/1516] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:30:15.988472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990df11-ea22-440a-baa0-8c173abcda8d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:15.989004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990df11-ea22-440a-baa0-8c173abcda8d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:15.989004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990df11-ea22-440a-baa0-8c173abcda8d None None] PATH_INFO: `/v3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:15.990237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 759/1517] 10.222.0.18 () {54 vars in 925 bytes} [Fri Jun 24 10:30:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:30:15.996042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5538-1e3f-43bd-9bab-643699b9d86b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:15.996449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5538-1e3f-43bd-9bab-643699b9d86b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:15.996610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5538-1e3f-43bd-9bab-643699b9d86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:16.014893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3d6b5538-1e3f-43bd-9bab-643699b9d86b None None] MFA Rules not processed for user `06d6f1eebcfa48349613455eb5d2aaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:30:16.016085 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3d6b5538-1e3f-43bd-9bab-643699b9d86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:16.077468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 759/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Jun 24 10:30:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:30:19.870600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168f8e3-f464-466a-bf9e-6afa311d181d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:19.871159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168f8e3-f464-466a-bf9e-6afa311d181d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:19.871159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168f8e3-f464-466a-bf9e-6afa311d181d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:19.872421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 760/1519] 10.222.0.44 () {54 vars in 960 bytes} [Fri Jun 24 10:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:30:19.877678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5abe-a61a-46e5-aee2-676f5f287bc5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:19.878071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5abe-a61a-46e5-aee2-676f5f287bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:19.878238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5abe-a61a-46e5-aee2-676f5f287bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:19.895937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7f6f5abe-a61a-46e5-aee2-676f5f287bc5 None None] MFA Rules not processed for user `06d6f1eebcfa48349613455eb5d2aaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:30:19.897132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7f6f5abe-a61a-46e5-aee2-676f5f287bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:19.905537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 760/1520] 10.222.0.44 () {58 vars in 1057 bytes} [Fri Jun 24 10:30:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:30:19.912903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168f8e3-f464-466a-bf9e-6afa311d181d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:30:19.926524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168f8e3-f464-466a-bf9e-6afa311d181d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:30:19.931355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182fe8a-37ba-465a-bebb-a5e8cdeb2d6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:30:19.933095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182fe8a-37ba-465a-bebb-a5e8cdeb2d6a service placement] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:19.933406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182fe8a-37ba-465a-bebb-a5e8cdeb2d6a service placement] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:19.933676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182fe8a-37ba-465a-bebb-a5e8cdeb2d6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:19.942131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182fe8a-37ba-465a-bebb-a5e8cdeb2d6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:30:19.943756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182fe8a-37ba-465a-bebb-a5e8cdeb2d6a service placement] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:30:19.953460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 761/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:30:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:30:25.774410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e6c4d-666c-40fa-a34d-1d65b5101ddb None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:25.774936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e6c4d-666c-40fa-a34d-1d65b5101ddb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:25.775054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e6c4d-666c-40fa-a34d-1d65b5101ddb None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:25.776986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:30:25.781752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc485-8e38-4d4d-9598-1bb20eff84ec None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:25.782192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc485-8e38-4d4d-9598-1bb20eff84ec None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:25.782298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc485-8e38-4d4d-9598-1bb20eff84ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:25.799790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f95bc485-8e38-4d4d-9598-1bb20eff84ec None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:30:25.800980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f95bc485-8e38-4d4d-9598-1bb20eff84ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:25.808735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:30:25.963488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e6c4d-666c-40fa-a34d-1d65b5101ddb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:30:25.977790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e6c4d-666c-40fa-a34d-1d65b5101ddb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:30:25.983453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208afbc6-8384-40a9-be96-7b6908c1e7c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:30:25.984123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208afbc6-8384-40a9-be96-7b6908c1e7c4 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:25.984413 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208afbc6-8384-40a9-be96-7b6908c1e7c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:25.984694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208afbc6-8384-40a9-be96-7b6908c1e7c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:25.992892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208afbc6-8384-40a9-be96-7b6908c1e7c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:30:25.994516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208afbc6-8384-40a9-be96-7b6908c1e7c4 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:30:26.004253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 762/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:30:26.818043 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3476f-2d52-4add-b8bd-d8c60164d8fb None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:26.818674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3476f-2d52-4add-b8bd-d8c60164d8fb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:26.818674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3476f-2d52-4add-b8bd-d8c60164d8fb None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:26.820005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 10:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:30:26.825086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da5936-a918-4da7-aa63-ff4667b2fa03 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:26.825514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da5936-a918-4da7-aa63-ff4667b2fa03 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:26.825621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da5936-a918-4da7-aa63-ff4667b2fa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:26.843828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-60da5936-a918-4da7-aa63-ff4667b2fa03 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:30:26.845009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-60da5936-a918-4da7-aa63-ff4667b2fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:26.852661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 10:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:30:27.002596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3476f-2d52-4add-b8bd-d8c60164d8fb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:30:27.016782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3476f-2d52-4add-b8bd-d8c60164d8fb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:30:27.022055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f543b-ccd2-4ef2-8fc2-e4b6e5f12c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:30:27.022714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f543b-ccd2-4ef2-8fc2-e4b6e5f12c1b service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:27.023001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f543b-ccd2-4ef2-8fc2-e4b6e5f12c1b service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:27.023280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f543b-ccd2-4ef2-8fc2-e4b6e5f12c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:27.031750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f543b-ccd2-4ef2-8fc2-e4b6e5f12c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:30:27.033321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f543b-ccd2-4ef2-8fc2-e4b6e5f12c1b service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:30:27.043571 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 764/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:30:31.086841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a0a6c-7e7b-484d-87d7-488658d28e76 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:31.087392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a0a6c-7e7b-484d-87d7-488658d28e76 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:31.087392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a0a6c-7e7b-484d-87d7-488658d28e76 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:31.089465 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:30:31.094796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97fcba-e35f-4521-835f-de7af08cca44 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:31.095229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97fcba-e35f-4521-835f-de7af08cca44 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:31.095360 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97fcba-e35f-4521-835f-de7af08cca44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:31.115826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4c97fcba-e35f-4521-835f-de7af08cca44 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:30:31.117050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4c97fcba-e35f-4521-835f-de7af08cca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:31.125173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:30:31.162690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a0a6c-7e7b-484d-87d7-488658d28e76 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:30:31.164393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c50a0a6c-7e7b-484d-87d7-488658d28e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:31.224712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a0a6c-7e7b-484d-87d7-488658d28e76 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:30:31.228909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a8d3b-7081-43d0-9c32-1e8bf9e2d08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:30:31.229573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a8d3b-7081-43d0-9c32-1e8bf9e2d08b service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:31.229840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a8d3b-7081-43d0-9c32-1e8bf9e2d08b service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:31.230113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a8d3b-7081-43d0-9c32-1e8bf9e2d08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:31.239528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a8d3b-7081-43d0-9c32-1e8bf9e2d08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:30:31.240993 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a8d3b-7081-43d0-9c32-1e8bf9e2d08b service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:30:31.247410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:30:31.252449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 765/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:30:33.325581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d5ddb-d225-4a6c-a9b1-aafbc073e35d None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:33.326108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d5ddb-d225-4a6c-a9b1-aafbc073e35d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:33.326203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d5ddb-d225-4a6c-a9b1-aafbc073e35d None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:33.327612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:30:33.333129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3dbfb-b3e7-474e-aa29-cc21ca47b13a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:33.333537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3dbfb-b3e7-474e-aa29-cc21ca47b13a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:33.333690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3dbfb-b3e7-474e-aa29-cc21ca47b13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:33.353005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-03b3dbfb-b3e7-474e-aa29-cc21ca47b13a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:30:33.354542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-03b3dbfb-b3e7-474e-aa29-cc21ca47b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:33.363681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:30:33.399973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d5ddb-d225-4a6c-a9b1-aafbc073e35d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:30:33.411897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d5ddb-d225-4a6c-a9b1-aafbc073e35d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:30:33.415514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ffef-fb66-4730-9096-71d5c358e4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:30:33.416157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ffef-fb66-4730-9096-71d5c358e4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:33.416439 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ffef-fb66-4730-9096-71d5c358e4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:33.416921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ffef-fb66-4730-9096-71d5c358e4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:33.426331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ffef-fb66-4730-9096-71d5c358e4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:30:33.427777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ffef-fb66-4730-9096-71d5c358e4b4 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:30:33.444555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 767/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:30:36.990895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f17d-586d-48f3-a028-47019a4d0518 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:36.991416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f17d-586d-48f3-a028-47019a4d0518 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:36.991416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f17d-586d-48f3-a028-47019a4d0518 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:36.995075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:30:36.998332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2456f9-0c19-4f1e-9d47-a39a20fa57e3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:36.998796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2456f9-0c19-4f1e-9d47-a39a20fa57e3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:36.998938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2456f9-0c19-4f1e-9d47-a39a20fa57e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:37.016502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ff2456f9-0c19-4f1e-9d47-a39a20fa57e3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:30:37.017695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ff2456f9-0c19-4f1e-9d47-a39a20fa57e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:37.025505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:30:37.326404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673f17d-586d-48f3-a028-47019a4d0518 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:30:37.328061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3673f17d-586d-48f3-a028-47019a4d0518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:37.385966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673f17d-586d-48f3-a028-47019a4d0518 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:30:37.389471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c7779-730f-41f2-84fa-9ac69afcd183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:30:37.390111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c7779-730f-41f2-84fa-9ac69afcd183 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:37.390424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c7779-730f-41f2-84fa-9ac69afcd183 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:37.390705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c7779-730f-41f2-84fa-9ac69afcd183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:37.399534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c7779-730f-41f2-84fa-9ac69afcd183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:30:37.400959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c7779-730f-41f2-84fa-9ac69afcd183 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:30:37.410954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 768/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:30:39.481400 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067259ca-6508-48b4-b36f-d3f30859f4ad None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:39.481970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067259ca-6508-48b4-b36f-d3f30859f4ad None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:39.481970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067259ca-6508-48b4-b36f-d3f30859f4ad None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:39.483365 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 10:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 10:30:39.488605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20cc5b-54bb-4e37-94ef-57b6214511ac None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:39.489048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20cc5b-54bb-4e37-94ef-57b6214511ac None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:39.489209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20cc5b-54bb-4e37-94ef-57b6214511ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:39.506789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0c20cc5b-54bb-4e37-94ef-57b6214511ac None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:30:39.507968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0c20cc5b-54bb-4e37-94ef-57b6214511ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:39.515549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 10:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:30:39.816586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067259ca-6508-48b4-b36f-d3f30859f4ad None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:30:39.818312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-067259ca-6508-48b4-b36f-d3f30859f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:30:39.826050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=65 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:30:39.832467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067259ca-6508-48b4-b36f-d3f30859f4ad None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:30:39.835993 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7df9aa-4be3-4f05-9edb-331365c7f506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:30:39.836628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7df9aa-4be3-4f05-9edb-331365c7f506 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:30:39.836915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7df9aa-4be3-4f05-9edb-331365c7f506 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:30:39.837197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7df9aa-4be3-4f05-9edb-331365c7f506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:30:39.846180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7df9aa-4be3-4f05-9edb-331365c7f506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:30:39.847622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7df9aa-4be3-4f05-9edb-331365c7f506 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:30:39.857706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 770/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:30:49.501731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=32 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:30:49.852802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:14.341375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc904c-b3d7-4961-a1ef-275171e36ca5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.342028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc904c-b3d7-4961-a1ef-275171e36ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.342028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc904c-b3d7-4961-a1ef-275171e36ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.364825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-11fc904c-b3d7-4961-a1ef-275171e36ca5 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.366314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-11fc904c-b3d7-4961-a1ef-275171e36ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.378512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 770/1540] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:14.389485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8b507-6058-47b7-a735-f810c83635bc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.390669 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8b507-6058-47b7-a735-f810c83635bc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.391191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8b507-6058-47b7-a735-f810c83635bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.421741 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-37e8b507-6058-47b7-a735-f810c83635bc None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.423026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-37e8b507-6058-47b7-a735-f810c83635bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.439746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 771/1541] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:14.446098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc904c-b3d7-4961-a1ef-275171e36ca5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:14.461302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc904c-b3d7-4961-a1ef-275171e36ca5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:14.469421 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b4e25-2fba-4a18-ab39-11242ed1c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:14.470247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b4e25-2fba-4a18-ab39-11242ed1c29b admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.470558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b4e25-2fba-4a18-ab39-11242ed1c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.470837 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b4e25-2fba-4a18-ab39-11242ed1c29b admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.471795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b4e25-2fba-4a18-ab39-11242ed1c29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:14.471992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b4e25-2fba-4a18-ab39-11242ed1c29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:14.473610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b4e25-2fba-4a18-ab39-11242ed1c29b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:14.494301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 771/1542] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:14.503654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8b507-6058-47b7-a735-f810c83635bc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:14.513603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8b507-6058-47b7-a735-f810c83635bc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:14.529223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422171e-b9a6-42f2-8393-c10174c45f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:14.529912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422171e-b9a6-42f2-8393-c10174c45f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.530197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422171e-b9a6-42f2-8393-c10174c45f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.530789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422171e-b9a6-42f2-8393-c10174c45f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.531345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422171e-b9a6-42f2-8393-c10174c45f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:14.532266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff5a4-3c0c-4e21-9a31-5d3780458132 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.532555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff5a4-3c0c-4e21-9a31-5d3780458132 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.532831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff5a4-3c0c-4e21-9a31-5d3780458132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.533251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422171e-b9a6-42f2-8393-c10174c45f8d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:14.572179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c84ff5a4-3c0c-4e21-9a31-5d3780458132 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.579595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c84ff5a4-3c0c-4e21-9a31-5d3780458132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.596920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 772/1543] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:14.613631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 772/1544] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:14.617828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f721b18-5e55-4ebb-92b2-3f9865990b96 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.618026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422171e-b9a6-42f2-8393-c10174c45f8d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:14.618117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f721b18-5e55-4ebb-92b2-3f9865990b96 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.618410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f721b18-5e55-4ebb-92b2-3f9865990b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.661316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2f721b18-5e55-4ebb-92b2-3f9865990b96 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.661316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2f721b18-5e55-4ebb-92b2-3f9865990b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.778101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422171e-b9a6-42f2-8393-c10174c45f8d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:14.788648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 773/1545] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:14.789774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae11f2a-6db3-4ce1-887c-b236a4a59fd0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.790064 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae11f2a-6db3-4ce1-887c-b236a4a59fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.790419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae11f2a-6db3-4ce1-887c-b236a4a59fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.793198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b82a7-54fe-4026-b684-674d364f3388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:14.793887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b82a7-54fe-4026-b684-674d364f3388 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.794523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b82a7-54fe-4026-b684-674d364f3388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.794807 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b82a7-54fe-4026-b684-674d364f3388 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.795519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b82a7-54fe-4026-b684-674d364f3388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:14.796541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-a22b82a7-54fe-4026-b684-674d364f3388 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:32:14.796541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: warnings.warn(msg) Jun 24 10:32:14.796541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: Jun 24 10:32:14.797763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b82a7-54fe-4026-b684-674d364f3388 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:14.824097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2ae11f2a-6db3-4ce1-887c-b236a4a59fd0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.825603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2ae11f2a-6db3-4ce1-887c-b236a4a59fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.834541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 773/1546] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/users => generated 303 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:32:14.834869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 774/1547] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:14.836230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee19f0e-fc9c-4225-830e-f70858f0094b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.836430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e96a8-6c22-4e82-8f95-5d51fc176f74 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.836716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee19f0e-fc9c-4225-830e-f70858f0094b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.837040 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e96a8-6c22-4e82-8f95-5d51fc176f74 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.837155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee19f0e-fc9c-4225-830e-f70858f0094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.837796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e96a8-6c22-4e82-8f95-5d51fc176f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.855405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fee19f0e-fc9c-4225-830e-f70858f0094b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.855906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8e2e96a8-6c22-4e82-8f95-5d51fc176f74 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.856534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fee19f0e-fc9c-4225-830e-f70858f0094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.857080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8e2e96a8-6c22-4e82-8f95-5d51fc176f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.865148 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 775/1548] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:14.865675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 774/1549] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:14.865933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee19f0e-fc9c-4225-830e-f70858f0094b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:14.866916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64de6c-833c-4bbb-b880-446f04c1f567 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.867205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64de6c-833c-4bbb-b880-446f04c1f567 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.867482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64de6c-833c-4bbb-b880-446f04c1f567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.881665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee19f0e-fc9c-4225-830e-f70858f0094b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:14.886260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6deaa-5e2b-4bc8-aa13-c7860e36d917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:14.886549 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2d64de6c-833c-4bbb-b880-446f04c1f567 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.886957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6deaa-5e2b-4bc8-aa13-c7860e36d917 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.887237 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6deaa-5e2b-4bc8-aa13-c7860e36d917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.887507 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6deaa-5e2b-4bc8-aa13-c7860e36d917 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.887720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2d64de6c-833c-4bbb-b880-446f04c1f567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.888254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6deaa-5e2b-4bc8-aa13-c7860e36d917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:14.888556 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6deaa-5e2b-4bc8-aa13-c7860e36d917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:14.890321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6deaa-5e2b-4bc8-aa13-c7860e36d917 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:14.896898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 775/1550] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:14.898396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506a2f6-955c-4af9-8911-bdece6b97863 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.898622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506a2f6-955c-4af9-8911-bdece6b97863 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.898843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506a2f6-955c-4af9-8911-bdece6b97863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.906735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 776/1551] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:14.908785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639b3c9-b361-46cb-9952-7bf86461c22f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.909081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639b3c9-b361-46cb-9952-7bf86461c22f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.909362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639b3c9-b361-46cb-9952-7bf86461c22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.924236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a506a2f6-955c-4af9-8911-bdece6b97863 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.925966 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a506a2f6-955c-4af9-8911-bdece6b97863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.929360 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0639b3c9-b361-46cb-9952-7bf86461c22f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.930555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0639b3c9-b361-46cb-9952-7bf86461c22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.934074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 776/1552] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:14.934760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506a2f6-955c-4af9-8911-bdece6b97863 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:14.945118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506a2f6-955c-4af9-8911-bdece6b97863 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:14.949336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 777/1553] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:14.950684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c7c3-c7b3-4266-98e0-9f590d908689 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.951038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c7c3-c7b3-4266-98e0-9f590d908689 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.951324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209c7c3-c7b3-4266-98e0-9f590d908689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.959682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8a1ec-d2d2-49e9-b297-2e7864d6e3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:14.960467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a1ec-d2d2-49e9-b297-2e7864d6e3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.960825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a1ec-d2d2-49e9-b297-2e7864d6e3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.961225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a1ec-d2d2-49e9-b297-2e7864d6e3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.962298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8a1ec-d2d2-49e9-b297-2e7864d6e3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:14.963733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8a1ec-d2d2-49e9-b297-2e7864d6e3c7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:14.978237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 777/1554] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:14.978237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ae2b1-f947-4246-8b1b-5960eb94382c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.978739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3209c7c3-c7b3-4266-98e0-9f590d908689 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.978850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ae2b1-f947-4246-8b1b-5960eb94382c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.978850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ae2b1-f947-4246-8b1b-5960eb94382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.979030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3209c7c3-c7b3-4266-98e0-9f590d908689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:14.986269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 778/1555] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:14.988160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb26500-0e52-45fc-a427-09cb1697e27d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:14.988452 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb26500-0e52-45fc-a427-09cb1697e27d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:14.988729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb26500-0e52-45fc-a427-09cb1697e27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:14.995743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-933ae2b1-f947-4246-8b1b-5960eb94382c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:14.996928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-933ae2b1-f947-4246-8b1b-5960eb94382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:15.004703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 778/1556] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:15.005894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba188ef-94e8-4661-92ad-3e5b5c17dce3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.006181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba188ef-94e8-4661-92ad-3e5b5c17dce3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.006486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba188ef-94e8-4661-92ad-3e5b5c17dce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.006594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4fb26500-0e52-45fc-a427-09cb1697e27d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:15.007749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4fb26500-0e52-45fc-a427-09cb1697e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:15.015557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 779/1557] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:15.016333 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb26500-0e52-45fc-a427-09cb1697e27d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.025008 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3ba188ef-94e8-4661-92ad-3e5b5c17dce3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:15.025349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb26500-0e52-45fc-a427-09cb1697e27d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.026174 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3ba188ef-94e8-4661-92ad-3e5b5c17dce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:15.030187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b16267-6d47-43f6-8cdb-eb55c13b8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.030872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16267-6d47-43f6-8cdb-eb55c13b8553 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.031164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16267-6d47-43f6-8cdb-eb55c13b8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.031445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16267-6d47-43f6-8cdb-eb55c13b8553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.032132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b16267-6d47-43f6-8cdb-eb55c13b8553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.033171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-00b16267-6d47-43f6-8cdb-eb55c13b8553 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:32:15.033171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: warnings.warn(msg) Jun 24 10:32:15.033171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: Jun 24 10:32:15.033850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 779/1558] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:15.038197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b16267-6d47-43f6-8cdb-eb55c13b8553 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.038432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39a7ee-b2a9-413a-a3d1-060474a54392 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.038432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39a7ee-b2a9-413a-a3d1-060474a54392 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.038432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39a7ee-b2a9-413a-a3d1-060474a54392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.054104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2e39a7ee-b2a9-413a-a3d1-060474a54392 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:15.055586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2e39a7ee-b2a9-413a-a3d1-060474a54392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:15.064249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 780/1559] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.064249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2207b-d2fb-4468-9ca0-5bbd1d374c69 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.064249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2207b-d2fb-4468-9ca0-5bbd1d374c69 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.064249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2207b-d2fb-4468-9ca0-5bbd1d374c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.064625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 780/1560] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:15.064625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39a7ee-b2a9-413a-a3d1-060474a54392 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.076465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39a7ee-b2a9-413a-a3d1-060474a54392 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.083663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e6c2207b-d2fb-4468-9ca0-5bbd1d374c69 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:15.085081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e6c2207b-d2fb-4468-9ca0-5bbd1d374c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:15.132603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a0f4-3f98-48e3-8e19-99c37864ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.133194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a0f4-3f98-48e3-8e19-99c37864ec31 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.133478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a0f4-3f98-48e3-8e19-99c37864ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.133762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a0f4-3f98-48e3-8e19-99c37864ec31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.134515 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348a0f4-3f98-48e3-8e19-99c37864ec31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.136137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348a0f4-3f98-48e3-8e19-99c37864ec31 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.143918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 781/1561] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:15.144714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2207b-d2fb-4468-9ca0-5bbd1d374c69 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.146111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 781/1562] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:15.149772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a0f4-3f98-48e3-8e19-99c37864ec31 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.153970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2207b-d2fb-4468-9ca0-5bbd1d374c69 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.158483 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e161c-ce37-418b-a753-ec5aa70c3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.159648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e161c-ce37-418b-a753-ec5aa70c3e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.159932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e161c-ce37-418b-a753-ec5aa70c3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.160168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a0f4-3f98-48e3-8e19-99c37864ec31 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.160269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e161c-ce37-418b-a753-ec5aa70c3e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.160910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e161c-ce37-418b-a753-ec5aa70c3e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:15.161308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e161c-ce37-418b-a753-ec5aa70c3e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.162924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e161c-ce37-418b-a753-ec5aa70c3e53 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.164444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:15.165181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf6553-e534-4c67-a317-b954c7e48f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.165800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6553-e534-4c67-a317-b954c7e48f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.166154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6553-e534-4c67-a317-b954c7e48f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.166735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6553-e534-4c67-a317-b954c7e48f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.167532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf6553-e534-4c67-a317-b954c7e48f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:15.168056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf6553-e534-4c67-a317-b954c7e48f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.168998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-eadf6553-e534-4c67-a317-b954c7e48f21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:32:15.168998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: warnings.warn(msg) Jun 24 10:32:15.168998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: Jun 24 10:32:15.169884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf6553-e534-4c67-a317-b954c7e48f21 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.171477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:15.179377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 782/1563] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:15.180519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e161c-ce37-418b-a753-ec5aa70c3e53 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.186232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 782/1564] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:15.187347 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf6553-e534-4c67-a317-b954c7e48f21 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.192369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e161c-ce37-418b-a753-ec5aa70c3e53 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.197471 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf6553-e534-4c67-a317-b954c7e48f21 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.197763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01017175-2221-45b6-984c-10555411a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.198460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01017175-2221-45b6-984c-10555411a18e admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.198751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01017175-2221-45b6-984c-10555411a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.199034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01017175-2221-45b6-984c-10555411a18e admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.199757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01017175-2221-45b6-984c-10555411a18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:15.200088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01017175-2221-45b6-984c-10555411a18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.201721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01017175-2221-45b6-984c-10555411a18e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.202296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b66a1-4865-495a-981c-63b29243130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.202969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b66a1-4865-495a-981c-63b29243130e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.203253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b66a1-4865-495a-981c-63b29243130e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.203527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b66a1-4865-495a-981c-63b29243130e admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.204243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b66a1-4865-495a-981c-63b29243130e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:15.204547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b66a1-4865-495a-981c-63b29243130e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.206312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b66a1-4865-495a-981c-63b29243130e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.214179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 783/1565] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:15.214898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01017175-2221-45b6-984c-10555411a18e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.219267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 783/1566] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:15.220237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b66a1-4865-495a-981c-63b29243130e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.230245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01017175-2221-45b6-984c-10555411a18e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.230740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b66a1-4865-495a-981c-63b29243130e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.235243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad57d1e-fb37-4050-b385-ce2ccb81c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.235615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978a6bf-1937-4c2c-b8ac-66abd46de14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.235895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57d1e-fb37-4050-b385-ce2ccb81c340 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.236177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57d1e-fb37-4050-b385-ce2ccb81c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.236272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a6bf-1937-4c2c-b8ac-66abd46de14a admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.236450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57d1e-fb37-4050-b385-ce2ccb81c340 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.236556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a6bf-1937-4c2c-b8ac-66abd46de14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.236776 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a6bf-1937-4c2c-b8ac-66abd46de14a admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.237733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad57d1e-fb37-4050-b385-ce2ccb81c340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.238047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978a6bf-1937-4c2c-b8ac-66abd46de14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:15.238379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978a6bf-1937-4c2c-b8ac-66abd46de14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.239817 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad57d1e-fb37-4050-b385-ce2ccb81c340 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.239992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978a6bf-1937-4c2c-b8ac-66abd46de14a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.253360 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 784/1567] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:15.254246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978a6bf-1937-4c2c-b8ac-66abd46de14a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.263434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 784/1568] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.264419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad57d1e-fb37-4050-b385-ce2ccb81c340 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.266004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978a6bf-1937-4c2c-b8ac-66abd46de14a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.270798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2d4c3-0813-48d0-b417-a4ad85c1ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.271439 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2d4c3-0813-48d0-b417-a4ad85c1ec6b admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.271883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2d4c3-0813-48d0-b417-a4ad85c1ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.272039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2d4c3-0813-48d0-b417-a4ad85c1ec6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.272763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2d4c3-0813-48d0-b417-a4ad85c1ec6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:15.273065 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2d4c3-0813-48d0-b417-a4ad85c1ec6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.274211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad57d1e-fb37-4050-b385-ce2ccb81c340 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.274703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2d4c3-0813-48d0-b417-a4ad85c1ec6b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.279327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92818a17-20ab-400f-af73-a1cb41998189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.280229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92818a17-20ab-400f-af73-a1cb41998189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.280542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92818a17-20ab-400f-af73-a1cb41998189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.280825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92818a17-20ab-400f-af73-a1cb41998189 admin admin] PATH_INFO: `/v3/projects/f3939939f7c3400b8ac15372accccd5c/users/27e9316df1754d7e9938cb2f0af7edd3/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.293653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 785/1569] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:15.293653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2d4c3-0813-48d0-b417-a4ad85c1ec6b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.297562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2d4c3-0813-48d0-b417-a4ad85c1ec6b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.301232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92818a17-20ab-400f-af73-a1cb41998189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3939939f7c3400b8ac15372accccd5c, user_id=27e9316df1754d7e9938cb2f0af7edd3, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.302315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-92818a17-20ab-400f-af73-a1cb41998189 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:32:15.302315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: warnings.warn(msg) Jun 24 10:32:15.302315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: Jun 24 10:32:15.302973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca8233-e9dd-4dd0-91ce-23c3cc7e21c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.303688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca8233-e9dd-4dd0-91ce-23c3cc7e21c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.303974 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca8233-e9dd-4dd0-91ce-23c3cc7e21c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.304252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca8233-e9dd-4dd0-91ce-23c3cc7e21c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.304352 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92818a17-20ab-400f-af73-a1cb41998189 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.304933 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca8233-e9dd-4dd0-91ce-23c3cc7e21c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.306839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca8233-e9dd-4dd0-91ce-23c3cc7e21c4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.317881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 785/1570] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:15 2022] PUT /identity/v3/projects/f3939939f7c3400b8ac15372accccd5c/users/27e9316df1754d7e9938cb2f0af7edd3/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:15.318533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92818a17-20ab-400f-af73-a1cb41998189 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.336970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 786/1571] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.337861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca8233-e9dd-4dd0-91ce-23c3cc7e21c4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.381549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92818a17-20ab-400f-af73-a1cb41998189 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.403173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca8233-e9dd-4dd0-91ce-23c3cc7e21c4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.408046 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a7e2a-fc4f-4a7b-ac1a-607f95df64e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.408697 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a7e2a-fc4f-4a7b-ac1a-607f95df64e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.409022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a7e2a-fc4f-4a7b-ac1a-607f95df64e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.409857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a7e2a-fc4f-4a7b-ac1a-607f95df64e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.410570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a7e2a-fc4f-4a7b-ac1a-607f95df64e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.412493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a7e2a-fc4f-4a7b-ac1a-607f95df64e3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.438912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 787/1572] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.439719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a7e2a-fc4f-4a7b-ac1a-607f95df64e3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.440140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc9af0-3a03-4f21-85bf-a62615742065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.441380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc9af0-3a03-4f21-85bf-a62615742065 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.441671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc9af0-3a03-4f21-85bf-a62615742065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.442010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc9af0-3a03-4f21-85bf-a62615742065 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.442835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc9af0-3a03-4f21-85bf-a62615742065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.444852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc9af0-3a03-4f21-85bf-a62615742065 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.473667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 786/1573] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.473667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc9af0-3a03-4f21-85bf-a62615742065 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.504085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a7e2a-fc4f-4a7b-ac1a-607f95df64e3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.506370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:15.524227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:15.536001 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc9af0-3a03-4f21-85bf-a62615742065 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.540699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc651fb-4062-439a-8086-720551de2e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.541355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc651fb-4062-439a-8086-720551de2e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.541644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc651fb-4062-439a-8086-720551de2e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.541925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc651fb-4062-439a-8086-720551de2e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.542648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc651fb-4062-439a-8086-720551de2e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.544607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc651fb-4062-439a-8086-720551de2e72 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.567576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569c365-602b-43bf-a079-f7ee7cda8d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.568251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569c365-602b-43bf-a079-f7ee7cda8d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.568594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569c365-602b-43bf-a079-f7ee7cda8d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.568875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569c365-602b-43bf-a079-f7ee7cda8d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.569567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569c365-602b-43bf-a079-f7ee7cda8d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.571699 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569c365-602b-43bf-a079-f7ee7cda8d7d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.572661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 787/1574] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.573737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc651fb-4062-439a-8086-720551de2e72 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.600664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 788/1575] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.600664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569c365-602b-43bf-a079-f7ee7cda8d7d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.637012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc651fb-4062-439a-8086-720551de2e72 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.658205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569c365-602b-43bf-a079-f7ee7cda8d7d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.662757 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9e85d-35b5-496d-bb8e-7bfe7cb4af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.663413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9e85d-35b5-496d-bb8e-7bfe7cb4af4e admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.663697 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9e85d-35b5-496d-bb8e-7bfe7cb4af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.663975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9e85d-35b5-496d-bb8e-7bfe7cb4af4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.664659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9e85d-35b5-496d-bb8e-7bfe7cb4af4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.666570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9e85d-35b5-496d-bb8e-7bfe7cb4af4e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.695673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 789/1576] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.695878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cfe23-e1b2-484b-86b9-2e97409c61be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.695986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91401876-f262-4366-878a-aa4ae410fd66 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.695986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91401876-f262-4366-878a-aa4ae410fd66 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.695986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91401876-f262-4366-878a-aa4ae410fd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.696228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cfe23-e1b2-484b-86b9-2e97409c61be admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.696228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cfe23-e1b2-484b-86b9-2e97409c61be admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.696228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cfe23-e1b2-484b-86b9-2e97409c61be admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.696228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cfe23-e1b2-484b-86b9-2e97409c61be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.697550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cfe23-e1b2-484b-86b9-2e97409c61be admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.709221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 788/1577] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:15.712932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cfe23-e1b2-484b-86b9-2e97409c61be admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.715714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-91401876-f262-4366-878a-aa4ae410fd66 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:15.716982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-91401876-f262-4366-878a-aa4ae410fd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:15.724117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cfe23-e1b2-484b-86b9-2e97409c61be admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.780135 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 790/1578] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:15.780135 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91401876-f262-4366-878a-aa4ae410fd66 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.781613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4858d-b680-472a-b998-3fa86aea471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.782366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4858d-b680-472a-b998-3fa86aea471d admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.782738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4858d-b680-472a-b998-3fa86aea471d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.783101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4858d-b680-472a-b998-3fa86aea471d admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.783861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4858d-b680-472a-b998-3fa86aea471d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.786377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4858d-b680-472a-b998-3fa86aea471d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.788031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91401876-f262-4366-878a-aa4ae410fd66 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.792659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586fd44-5070-41fb-b7a8-1e7353d014ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.793165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:15.793318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586fd44-5070-41fb-b7a8-1e7353d014ab admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.793604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586fd44-5070-41fb-b7a8-1e7353d014ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.793887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586fd44-5070-41fb-b7a8-1e7353d014ab admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.794702 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586fd44-5070-41fb-b7a8-1e7353d014ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.796873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586fd44-5070-41fb-b7a8-1e7353d014ab admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.809739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 789/1579] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.813123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4858d-b680-472a-b998-3fa86aea471d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.820255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4858d-b680-472a-b998-3fa86aea471d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.825576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 791/1580] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.825576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586fd44-5070-41fb-b7a8-1e7353d014ab admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.828102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f70064-a764-4aa5-9d9d-b79545fe9321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.828747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70064-a764-4aa5-9d9d-b79545fe9321 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.829029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70064-a764-4aa5-9d9d-b79545fe9321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.829299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70064-a764-4aa5-9d9d-b79545fe9321 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.829973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f70064-a764-4aa5-9d9d-b79545fe9321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.832131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f70064-a764-4aa5-9d9d-b79545fe9321 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.835685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586fd44-5070-41fb-b7a8-1e7353d014ab admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.840734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c33361-a3cd-41e5-994a-fd47b95719db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.841321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c33361-a3cd-41e5-994a-fd47b95719db admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.841621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c33361-a3cd-41e5-994a-fd47b95719db admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.841898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c33361-a3cd-41e5-994a-fd47b95719db admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.842658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c33361-a3cd-41e5-994a-fd47b95719db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.844617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c33361-a3cd-41e5-994a-fd47b95719db admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.852079 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 790/1581] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.853206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f70064-a764-4aa5-9d9d-b79545fe9321 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.860630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:15.864949 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f70064-a764-4aa5-9d9d-b79545fe9321 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.867518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 792/1582] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.868465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c33361-a3cd-41e5-994a-fd47b95719db admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.870706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f242b-95b9-4532-b82d-0b6a9a54b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.871361 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f242b-95b9-4532-b82d-0b6a9a54b1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.871644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f242b-95b9-4532-b82d-0b6a9a54b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.871916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f242b-95b9-4532-b82d-0b6a9a54b1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.872590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f242b-95b9-4532-b82d-0b6a9a54b1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.874612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f242b-95b9-4532-b82d-0b6a9a54b1a1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.878781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c33361-a3cd-41e5-994a-fd47b95719db admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.883794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bfc5a-4e39-4c7d-9846-032d7daa34b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.884557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bfc5a-4e39-4c7d-9846-032d7daa34b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.884882 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bfc5a-4e39-4c7d-9846-032d7daa34b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.885205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bfc5a-4e39-4c7d-9846-032d7daa34b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.885973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bfc5a-4e39-4c7d-9846-032d7daa34b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.888265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bfc5a-4e39-4c7d-9846-032d7daa34b9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.895213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 791/1583] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.899195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f242b-95b9-4532-b82d-0b6a9a54b1a1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.912689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 793/1584] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:15 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:15.912860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f242b-95b9-4532-b82d-0b6a9a54b1a1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.912966 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bfc5a-4e39-4c7d-9846-032d7daa34b9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.915415 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cd66e-13bf-4fe2-b38a-62fed5c7df65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.916079 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cd66e-13bf-4fe2-b38a-62fed5c7df65 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.916395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cd66e-13bf-4fe2-b38a-62fed5c7df65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.916675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cd66e-13bf-4fe2-b38a-62fed5c7df65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.917436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cd66e-13bf-4fe2-b38a-62fed5c7df65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.919166 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cd66e-13bf-4fe2-b38a-62fed5c7df65 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.930011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 792/1585] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:15.931037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cd66e-13bf-4fe2-b38a-62fed5c7df65 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.941526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cd66e-13bf-4fe2-b38a-62fed5c7df65 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.946075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38781-c1cf-4e54-81c8-0574361f89a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.946779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38781-c1cf-4e54-81c8-0574361f89a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.947067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38781-c1cf-4e54-81c8-0574361f89a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.947347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38781-c1cf-4e54-81c8-0574361f89a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.948065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d38781-c1cf-4e54-81c8-0574361f89a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.949666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d38781-c1cf-4e54-81c8-0574361f89a1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.959490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 793/1586] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:15.960351 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38781-c1cf-4e54-81c8-0574361f89a1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.966677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bfc5a-4e39-4c7d-9846-032d7daa34b9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.969717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38781-c1cf-4e54-81c8-0574361f89a1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:15.970374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdec00e-965a-4c45-a6d2-056994f856cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.971023 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdec00e-965a-4c45-a6d2-056994f856cc service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.972384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdec00e-965a-4c45-a6d2-056994f856cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.972667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdec00e-965a-4c45-a6d2-056994f856cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.974812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db95de-ab46-432c-98f2-89c8c0767df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:15.975439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db95de-ab46-432c-98f2-89c8c0767df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:15.975728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db95de-ab46-432c-98f2-89c8c0767df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:15.976010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db95de-ab46-432c-98f2-89c8c0767df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:15.976721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db95de-ab46-432c-98f2-89c8c0767df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.978294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db95de-ab46-432c-98f2-89c8c0767df7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.982542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdec00e-965a-4c45-a6d2-056994f856cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:15.984213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdec00e-965a-4c45-a6d2-056994f856cc service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:15.989480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 794/1587] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:15.990370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db95de-ab46-432c-98f2-89c8c0767df7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:15.994479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 794/1588] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:15.995343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdec00e-965a-4c45-a6d2-056994f856cc service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.000094 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db95de-ab46-432c-98f2-89c8c0767df7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.004797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51f24f-eceb-42f5-9ee6-7103b5a4f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.004937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdec00e-965a-4c45-a6d2-056994f856cc service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.005450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51f24f-eceb-42f5-9ee6-7103b5a4f5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.005738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51f24f-eceb-42f5-9ee6-7103b5a4f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.006021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51f24f-eceb-42f5-9ee6-7103b5a4f5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.006778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51f24f-eceb-42f5-9ee6-7103b5a4f5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.008375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51f24f-eceb-42f5-9ee6-7103b5a4f5d4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.011303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1780-48a5-44b1-ae23-935e494be6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.011628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1780-48a5-44b1-ae23-935e494be6eb admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.012007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1780-48a5-44b1-ae23-935e494be6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.012378 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1780-48a5-44b1-ae23-935e494be6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.013200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1780-48a5-44b1-ae23-935e494be6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.015583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1780-48a5-44b1-ae23-935e494be6eb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.018828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 795/1589] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:16.019796 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51f24f-eceb-42f5-9ee6-7103b5a4f5d4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.028358 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 795/1590] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:16.030539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51f24f-eceb-42f5-9ee6-7103b5a4f5d4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.031740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1780-48a5-44b1-ae23-935e494be6eb admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.035931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11289c18-4d46-4061-bd68-a2fb8b049ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.036596 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11289c18-4d46-4061-bd68-a2fb8b049ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.036886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11289c18-4d46-4061-bd68-a2fb8b049ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.037188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11289c18-4d46-4061-bd68-a2fb8b049ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.037922 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11289c18-4d46-4061-bd68-a2fb8b049ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.039707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11289c18-4d46-4061-bd68-a2fb8b049ed5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.043176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1780-48a5-44b1-ae23-935e494be6eb admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.048184 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0ed8-0326-4af4-9049-503fb1f3c779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.048835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0ed8-0326-4af4-9049-503fb1f3c779 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.049122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0ed8-0326-4af4-9049-503fb1f3c779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.049415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0ed8-0326-4af4-9049-503fb1f3c779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.050735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 796/1591] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:16.050862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d0ed8-0326-4af4-9049-503fb1f3c779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.052399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d0ed8-0326-4af4-9049-503fb1f3c779 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.054823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11289c18-4d46-4061-bd68-a2fb8b049ed5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.063172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 796/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:16.064193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0ed8-0326-4af4-9049-503fb1f3c779 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.065152 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11289c18-4d46-4061-bd68-a2fb8b049ed5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.076377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0ed8-0326-4af4-9049-503fb1f3c779 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.077838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f436a-4d5a-4045-9ff2-ddaf099df4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.079155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f436a-4d5a-4045-9ff2-ddaf099df4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.079445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f436a-4d5a-4045-9ff2-ddaf099df4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.079724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f436a-4d5a-4045-9ff2-ddaf099df4b0 admin admin] PATH_INFO: `/v3/projects/35d691c5a5b340438cff9eb0b46ed89f/users/4fc4ced89bd741f7ac92e5a5a2dc6653/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.086143 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fb646-51ef-4c60-8a65-6a0f3679d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.087292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fb646-51ef-4c60-8a65-6a0f3679d0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.087851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fb646-51ef-4c60-8a65-6a0f3679d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.088278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fb646-51ef-4c60-8a65-6a0f3679d0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.089185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fb646-51ef-4c60-8a65-6a0f3679d0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.091071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fb646-51ef-4c60-8a65-6a0f3679d0f3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.099215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f436a-4d5a-4045-9ff2-ddaf099df4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d691c5a5b340438cff9eb0b46ed89f, user_id=4fc4ced89bd741f7ac92e5a5a2dc6653, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.101886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f436a-4d5a-4045-9ff2-ddaf099df4b0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.107875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 797/1593] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:16.107875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fb646-51ef-4c60-8a65-6a0f3679d0f3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.117481 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fb646-51ef-4c60-8a65-6a0f3679d0f3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.120670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 797/1594] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:16 2022] PUT /identity/v3/projects/35d691c5a5b340438cff9eb0b46ed89f/users/4fc4ced89bd741f7ac92e5a5a2dc6653/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:16.121704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f436a-4d5a-4045-9ff2-ddaf099df4b0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.193891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4cd04-9f89-49fb-acbd-db1f460fc63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.195190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4cd04-9f89-49fb-acbd-db1f460fc63e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.195190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4cd04-9f89-49fb-acbd-db1f460fc63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.195190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4cd04-9f89-49fb-acbd-db1f460fc63e admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.195953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4cd04-9f89-49fb-acbd-db1f460fc63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.197916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4cd04-9f89-49fb-acbd-db1f460fc63e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.199286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f436a-4d5a-4045-9ff2-ddaf099df4b0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.204564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2a8d0-1546-4abc-a376-96efd0a71a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.205356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2a8d0-1546-4abc-a376-96efd0a71a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.205814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2a8d0-1546-4abc-a376-96efd0a71a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.206692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2a8d0-1546-4abc-a376-96efd0a71a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.207539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2a8d0-1546-4abc-a376-96efd0a71a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.209379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2a8d0-1546-4abc-a376-96efd0a71a55 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.209979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 798/1595] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:16.210671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4cd04-9f89-49fb-acbd-db1f460fc63e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.220949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4cd04-9f89-49fb-acbd-db1f460fc63e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.222730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 798/1596] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:16.224369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2a8d0-1546-4abc-a376-96efd0a71a55 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.230515 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9d084-fe3c-4bf6-917b-a80c81806653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.230515 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d084-fe3c-4bf6-917b-a80c81806653 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.230912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d084-fe3c-4bf6-917b-a80c81806653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.231071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d084-fe3c-4bf6-917b-a80c81806653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.231888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9d084-fe3c-4bf6-917b-a80c81806653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.233394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9d084-fe3c-4bf6-917b-a80c81806653 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.248701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 799/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:16.249917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9d084-fe3c-4bf6-917b-a80c81806653 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.251448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2a8d0-1546-4abc-a376-96efd0a71a55 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.261539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7cdce-0f78-4639-ad74-1d7b6e180cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.262251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9d084-fe3c-4bf6-917b-a80c81806653 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.262675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7cdce-0f78-4639-ad74-1d7b6e180cab admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.263145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7cdce-0f78-4639-ad74-1d7b6e180cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.263567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7cdce-0f78-4639-ad74-1d7b6e180cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.265042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7cdce-0f78-4639-ad74-1d7b6e180cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.266925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7cdce-0f78-4639-ad74-1d7b6e180cab admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.267129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900228c1-d9b5-439e-9052-45e49ef2109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.267817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900228c1-d9b5-439e-9052-45e49ef2109c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.268107 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900228c1-d9b5-439e-9052-45e49ef2109c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.268918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900228c1-d9b5-439e-9052-45e49ef2109c admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.269689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900228c1-d9b5-439e-9052-45e49ef2109c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.271682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900228c1-d9b5-439e-9052-45e49ef2109c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.279972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 799/1598] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:16.281231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7cdce-0f78-4639-ad74-1d7b6e180cab admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.289913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 800/1599] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:16.291493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29f64-07a3-4ea5-9b5c-13377dd6f7f2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.292091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29f64-07a3-4ea5-9b5c-13377dd6f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.292531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29f64-07a3-4ea5-9b5c-13377dd6f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.293201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7cdce-0f78-4639-ad74-1d7b6e180cab admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.297926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc624b7-42c1-41d5-a29c-016274b54591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.298850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc624b7-42c1-41d5-a29c-016274b54591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.299137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc624b7-42c1-41d5-a29c-016274b54591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.299438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc624b7-42c1-41d5-a29c-016274b54591 admin admin] PATH_INFO: `/v3/projects/e01d0638282643e9bda4272799551fb9/users/6ca2454700fa46dbbfe0fe44bcbc266c/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.315016 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc624b7-42c1-41d5-a29c-016274b54591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01d0638282643e9bda4272799551fb9, user_id=6ca2454700fa46dbbfe0fe44bcbc266c, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.318187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc624b7-42c1-41d5-a29c-016274b54591 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.319424 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-54e29f64-07a3-4ea5-9b5c-13377dd6f7f2 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:16.321239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-54e29f64-07a3-4ea5-9b5c-13377dd6f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:16.322827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:16.333603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 801/1600] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:16.334945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e29f64-07a3-4ea5-9b5c-13377dd6f7f2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.336423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 800/1601] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:16 2022] PUT /identity/v3/projects/e01d0638282643e9bda4272799551fb9/users/6ca2454700fa46dbbfe0fe44bcbc266c/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:16.337671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc624b7-42c1-41d5-a29c-016274b54591 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.348248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e29f64-07a3-4ea5-9b5c-13377dd6f7f2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.366802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:16.409819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc624b7-42c1-41d5-a29c-016274b54591 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.415243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778f9a-b967-4538-b075-bd47b0742e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.415732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778f9a-b967-4538-b075-bd47b0742e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.416106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778f9a-b967-4538-b075-bd47b0742e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.416383 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778f9a-b967-4538-b075-bd47b0742e20 admin admin] PATH_INFO: `/v3/projects/5689d68ff6b945a995f3c6a57f00d8d8/users/4a4e638dc0dd459699b76df35568e795/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.434133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e778f9a-b967-4538-b075-bd47b0742e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5689d68ff6b945a995f3c6a57f00d8d8, user_id=4a4e638dc0dd459699b76df35568e795, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.435346 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf693f-448e-47aa-b8aa-954472537adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.436387 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf693f-448e-47aa-b8aa-954472537adf admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.436672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf693f-448e-47aa-b8aa-954472537adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.436945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf693f-448e-47aa-b8aa-954472537adf admin admin] PATH_INFO: `/v3/projects/eb1eff66e8ef4283a28fecafbff9c1f1/users/1b925b5e87dc489db1dd5e994e47e5e7/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.439089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e778f9a-b967-4538-b075-bd47b0742e20 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.456792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf693f-448e-47aa-b8aa-954472537adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1eff66e8ef4283a28fecafbff9c1f1, user_id=1b925b5e87dc489db1dd5e994e47e5e7, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.459970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf693f-448e-47aa-b8aa-954472537adf admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.462660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 801/1602] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:16 2022] PUT /identity/v3/projects/5689d68ff6b945a995f3c6a57f00d8d8/users/4a4e638dc0dd459699b76df35568e795/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:16.464788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778f9a-b967-4538-b075-bd47b0742e20 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.479318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 802/1603] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:16 2022] PUT /identity/v3/projects/eb1eff66e8ef4283a28fecafbff9c1f1/users/1b925b5e87dc489db1dd5e994e47e5e7/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:16.480682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf693f-448e-47aa-b8aa-954472537adf admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.543499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778f9a-b967-4538-b075-bd47b0742e20 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.562903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf693f-448e-47aa-b8aa-954472537adf admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.569816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5841a-f068-44f5-835f-292600f42ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.571810 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5841a-f068-44f5-835f-292600f42ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.572174 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5841a-f068-44f5-835f-292600f42ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.572527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5841a-f068-44f5-835f-292600f42ddd admin admin] PATH_INFO: `/v3/projects/fa2deaeba2164ca6bee41ccd6cb59fa1/users/c15053da498b4b7d8646b1bc185de539/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.598856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5841a-f068-44f5-835f-292600f42ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2deaeba2164ca6bee41ccd6cb59fa1, user_id=c15053da498b4b7d8646b1bc185de539, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.603569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5841a-f068-44f5-835f-292600f42ddd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.617512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5782b31-c97c-413e-b953-95e2f4b8e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.618452 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782b31-c97c-413e-b953-95e2f4b8e1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.618740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782b31-c97c-413e-b953-95e2f4b8e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.619017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782b31-c97c-413e-b953-95e2f4b8e1b9 admin admin] PATH_INFO: `/v3/projects/2074a2921b4442b09da2c325559ee583/users/7cd9fb385165490cb1b9ffb11dcb73a1/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.622049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 803/1604] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:16 2022] PUT /identity/v3/projects/fa2deaeba2164ca6bee41ccd6cb59fa1/users/c15053da498b4b7d8646b1bc185de539/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:16.623424 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5841a-f068-44f5-835f-292600f42ddd admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.639275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5782b31-c97c-413e-b953-95e2f4b8e1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2074a2921b4442b09da2c325559ee583, user_id=7cd9fb385165490cb1b9ffb11dcb73a1, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.642207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5782b31-c97c-413e-b953-95e2f4b8e1b9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.658861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 802/1605] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:16 2022] PUT /identity/v3/projects/2074a2921b4442b09da2c325559ee583/users/7cd9fb385165490cb1b9ffb11dcb73a1/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:16.660138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34e1fc-ff0c-487c-9575-9b3879da6c71 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.660423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34e1fc-ff0c-487c-9575-9b3879da6c71 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.660697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34e1fc-ff0c-487c-9575-9b3879da6c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.679732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2e34e1fc-ff0c-487c-9575-9b3879da6c71 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:16.680872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2e34e1fc-ff0c-487c-9575-9b3879da6c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:16.685944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:16.712307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5841a-f068-44f5-835f-292600f42ddd admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.752437 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:16.754144 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 803/1606] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:16.763359 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34e1fc-ff0c-487c-9575-9b3879da6c71 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:16.765468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2e34e1fc-ff0c-487c-9575-9b3879da6c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:16.792728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf652c4-b4df-424a-9d34-574ed8ee5089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.793695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf652c4-b4df-424a-9d34-574ed8ee5089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.794156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf652c4-b4df-424a-9d34-574ed8ee5089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.794473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf652c4-b4df-424a-9d34-574ed8ee5089 admin admin] PATH_INFO: `/v3/projects/845bbc7de6b94e6389d9bf5e1f6c6586/users/6e971595d77647dca5a29a5574c6627d/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.814122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf652c4-b4df-424a-9d34-574ed8ee5089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845bbc7de6b94e6389d9bf5e1f6c6586, user_id=6e971595d77647dca5a29a5574c6627d, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:16.817628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf652c4-b4df-424a-9d34-574ed8ee5089 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:16.852695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 804/1607] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:16 2022] PUT /identity/v3/projects/845bbc7de6b94e6389d9bf5e1f6c6586/users/6e971595d77647dca5a29a5574c6627d/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:16.857506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ac0d-d550-43e5-b9c7-6e761cda9089 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.857907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ac0d-d550-43e5-b9c7-6e761cda9089 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.858451 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ac0d-d550-43e5-b9c7-6e761cda9089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.879135 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c2e4ac0d-d550-43e5-b9c7-6e761cda9089 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:16.880540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c2e4ac0d-d550-43e5-b9c7-6e761cda9089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:16.893857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34e1fc-ff0c-487c-9575-9b3879da6c71 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:16.954551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cf450-b9bc-4582-956f-d747932ed72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:16.955171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf450-b9bc-4582-956f-d747932ed72d service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.955408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf450-b9bc-4582-956f-d747932ed72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.955688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf450-b9bc-4582-956f-d747932ed72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:16.976583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 805/1608] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:16.977526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d7aab-03ec-4749-a24d-752dc1581e69 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:16.977804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d7aab-03ec-4749-a24d-752dc1581e69 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:16.978467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d7aab-03ec-4749-a24d-752dc1581e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.005238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b99d7aab-03ec-4749-a24d-752dc1581e69 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:17.006482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b99d7aab-03ec-4749-a24d-752dc1581e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:17.016955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 806/1609] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:17.016955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb07f-a065-4f47-a00c-f2baf8b20d77 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.016955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb07f-a065-4f47-a00c-f2baf8b20d77 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.016955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb07f-a065-4f47-a00c-f2baf8b20d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.029478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cf450-b9bc-4582-956f-d747932ed72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:17.031061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cf450-b9bc-4582-956f-d747932ed72d service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:17.043498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a3dfb07f-a065-4f47-a00c-f2baf8b20d77 None None] MFA Rules not processed for user `c15053da498b4b7d8646b1bc185de539`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:17.044762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a3dfb07f-a065-4f47-a00c-f2baf8b20d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:17.046778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 804/1610] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:17.047912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53454fad-6559-4f6d-9453-027ee94363ca None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.048575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53454fad-6559-4f6d-9453-027ee94363ca None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.048575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53454fad-6559-4f6d-9453-027ee94363ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.099933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-53454fad-6559-4f6d-9453-027ee94363ca None None] MFA Rules not processed for user `7cd9fb385165490cb1b9ffb11dcb73a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:17.102541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-53454fad-6559-4f6d-9453-027ee94363ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:17.108940 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:17.151123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 807/1611] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:17.152431 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfb07f-a065-4f47-a00c-f2baf8b20d77 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:17.166582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfb07f-a065-4f47-a00c-f2baf8b20d77 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:17.173071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59297625-cd42-41ad-b2dc-c732d06dd225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:17.173543 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297625-cd42-41ad-b2dc-c732d06dd225 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.173947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297625-cd42-41ad-b2dc-c732d06dd225 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.174330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297625-cd42-41ad-b2dc-c732d06dd225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.188785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59297625-cd42-41ad-b2dc-c732d06dd225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:17.191649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59297625-cd42-41ad-b2dc-c732d06dd225 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:17.198158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 805/1612] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:17.200207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6f5cb-1aba-454f-8cdb-6a09a6534687 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.200859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6f5cb-1aba-454f-8cdb-6a09a6534687 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.201288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6f5cb-1aba-454f-8cdb-6a09a6534687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.210610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 808/1613] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:17.212179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aae35-26e1-4f51-a5b5-7518834df2a8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.212579 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aae35-26e1-4f51-a5b5-7518834df2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.212965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aae35-26e1-4f51-a5b5-7518834df2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.226278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-88b6f5cb-1aba-454f-8cdb-6a09a6534687 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:17.228018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-88b6f5cb-1aba-454f-8cdb-6a09a6534687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:17.239087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 806/1614] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:17.240088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6f5cb-1aba-454f-8cdb-6a09a6534687 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:17.252072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6f5cb-1aba-454f-8cdb-6a09a6534687 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:17.253764 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-fb8aae35-26e1-4f51-a5b5-7518834df2a8 None None] MFA Rules not processed for user `27e9316df1754d7e9938cb2f0af7edd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:17.255240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-fb8aae35-26e1-4f51-a5b5-7518834df2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:17.256776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cc19f-dc76-40bd-8321-6e79818b94cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:17.257526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cc19f-dc76-40bd-8321-6e79818b94cf service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.257883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cc19f-dc76-40bd-8321-6e79818b94cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.258454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cc19f-dc76-40bd-8321-6e79818b94cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.269812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cc19f-dc76-40bd-8321-6e79818b94cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:17.271429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cc19f-dc76-40bd-8321-6e79818b94cf service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:17.272370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:17.283955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 807/1615] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:17.285602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cc19f-dc76-40bd-8321-6e79818b94cf service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:17.295074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cc19f-dc76-40bd-8321-6e79818b94cf service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:17.299209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f038c2b-4382-4f5d-a736-a1bc375cc6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:17.300747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038c2b-4382-4f5d-a736-a1bc375cc6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.301057 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038c2b-4382-4f5d-a736-a1bc375cc6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.301377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038c2b-4382-4f5d-a736-a1bc375cc6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.312566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f038c2b-4382-4f5d-a736-a1bc375cc6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:17.313878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f038c2b-4382-4f5d-a736-a1bc375cc6c7 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:17.326141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 808/1616] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:17.327543 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87754bb-cf5f-4f2f-8d26-547897b40c98 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.327834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87754bb-cf5f-4f2f-8d26-547897b40c98 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.328153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87754bb-cf5f-4f2f-8d26-547897b40c98 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.329665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 809/1617] 10.222.0.44 () {54 vars in 961 bytes} [Fri Jun 24 10:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:32:17.331501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bc9fd-65a0-4a83-bc66-902ad386912f None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.331793 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bc9fd-65a0-4a83-bc66-902ad386912f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.332071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bc9fd-65a0-4a83-bc66-902ad386912f None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.333576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 810/1618] 10.222.0.44 () {54 vars in 961 bytes} [Fri Jun 24 10:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:32:17.334790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bc9fd-65a0-4a83-bc66-902ad386912f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:17.355325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bc9fd-65a0-4a83-bc66-902ad386912f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:17.356372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 809/1619] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:17.358637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd282-fc9b-4a6a-a1d9-f269a358fa68 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.358937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd282-fc9b-4a6a-a1d9-f269a358fa68 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.359479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd282-fc9b-4a6a-a1d9-f269a358fa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.367613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b425b8-4603-48fe-b18e-7960f2ed4731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:17.368160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b425b8-4603-48fe-b18e-7960f2ed4731 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.368647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b425b8-4603-48fe-b18e-7960f2ed4731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.369063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b425b8-4603-48fe-b18e-7960f2ed4731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.384053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b425b8-4603-48fe-b18e-7960f2ed4731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:17.385796 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b425b8-4603-48fe-b18e-7960f2ed4731 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:17.386646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6c7bd282-fc9b-4a6a-a1d9-f269a358fa68 None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:17.388131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6c7bd282-fc9b-4a6a-a1d9-f269a358fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:17.400790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 811/1620] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:17.402482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3288e-0d40-4e08-b31c-5e0e6b088bfa None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.403023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3288e-0d40-4e08-b31c-5e0e6b088bfa None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.403328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3288e-0d40-4e08-b31c-5e0e6b088bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.427727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-99a3288e-0d40-4e08-b31c-5e0e6b088bfa None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:17.429099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-99a3288e-0d40-4e08-b31c-5e0e6b088bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:17.512198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 810/1621] 10.222.0.44 () {58 vars in 1058 bytes} [Fri Jun 24 10:32:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:17.513649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bd282-fc9b-4a6a-a1d9-f269a358fa68 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:17.538230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bd282-fc9b-4a6a-a1d9-f269a358fa68 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:17.551114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e8b3a-3bb1-42f9-aa5f-855e70cbb088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:17.552908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e8b3a-3bb1-42f9-aa5f-855e70cbb088 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.553137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e8b3a-3bb1-42f9-aa5f-855e70cbb088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.553424 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e8b3a-3bb1-42f9-aa5f-855e70cbb088 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.558075 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e8b3a-3bb1-42f9-aa5f-855e70cbb088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:17.561083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e8b3a-3bb1-42f9-aa5f-855e70cbb088 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:17.590010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 812/1622] 10.222.0.44 () {58 vars in 1058 bytes} [Fri Jun 24 10:32:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:17.591040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3288e-0d40-4e08-b31c-5e0e6b088bfa None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:17.600282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 811/1623] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:17 2022] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:17.601478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e8b3a-3bb1-42f9-aa5f-855e70cbb088 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:17.609951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3288e-0d40-4e08-b31c-5e0e6b088bfa None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:17.678180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:17.694070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e8b3a-3bb1-42f9-aa5f-855e70cbb088 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:17.700331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803eb89-85a1-4ff4-9248-86b2d43c7df0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:17.700504 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875910f9-f95b-4d74-897b-a402b242bc93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:17.700888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803eb89-85a1-4ff4-9248-86b2d43c7df0 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.701017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875910f9-f95b-4d74-897b-a402b242bc93 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.701178 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803eb89-85a1-4ff4-9248-86b2d43c7df0 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.701285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875910f9-f95b-4d74-897b-a402b242bc93 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.701473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875910f9-f95b-4d74-897b-a402b242bc93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.701634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803eb89-85a1-4ff4-9248-86b2d43c7df0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.730049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:17.780404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875910f9-f95b-4d74-897b-a402b242bc93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:17.782957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875910f9-f95b-4d74-897b-a402b242bc93 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:17.789163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803eb89-85a1-4ff4-9248-86b2d43c7df0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:17.791214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803eb89-85a1-4ff4-9248-86b2d43c7df0 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:17.797852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 812/1624] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:17.799168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875910f9-f95b-4d74-897b-a402b242bc93 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:17.805450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 813/1625] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:17.901625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875910f9-f95b-4d74-897b-a402b242bc93 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:17.911904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6510a8-041a-4ccc-8633-f390a5e667e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:17.913131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6510a8-041a-4ccc-8633-f390a5e667e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:17.919149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6510a8-041a-4ccc-8633-f390a5e667e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:17.921188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6510a8-041a-4ccc-8633-f390a5e667e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:17.925152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6510a8-041a-4ccc-8633-f390a5e667e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:17.934420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6510a8-041a-4ccc-8633-f390a5e667e3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:18.000189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803eb89-85a1-4ff4-9248-86b2d43c7df0 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:18.000913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 813/1626] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:17 2022] POST /identity/v3/users => generated 309 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:18.017030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803eb89-85a1-4ff4-9248-86b2d43c7df0 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:18.028910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad89ad8-5a83-48df-a3ed-7ea27fcb5058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:18.029804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad89ad8-5a83-48df-a3ed-7ea27fcb5058 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:18.030196 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad89ad8-5a83-48df-a3ed-7ea27fcb5058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:18.030660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad89ad8-5a83-48df-a3ed-7ea27fcb5058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:18.031509 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad89ad8-5a83-48df-a3ed-7ea27fcb5058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:18.034150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad89ad8-5a83-48df-a3ed-7ea27fcb5058 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:18.058893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 814/1627] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:32:18.060368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6510a8-041a-4ccc-8633-f390a5e667e3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:18.078691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6510a8-041a-4ccc-8633-f390a5e667e3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:18.099501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2aed4-aeca-4120-abbc-978100132bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:18.100842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2aed4-aeca-4120-abbc-978100132bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:18.101349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2aed4-aeca-4120-abbc-978100132bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:18.101951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2aed4-aeca-4120-abbc-978100132bcb admin admin] PATH_INFO: `/v3/projects/424f44e462314b2e8c2af5616c0ae4c9/users/74d3f9373fa340edabf600cd96497019/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:18.137858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2aed4-aeca-4120-abbc-978100132bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=424f44e462314b2e8c2af5616c0ae4c9, user_id=74d3f9373fa340edabf600cd96497019, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:18.141002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2aed4-aeca-4120-abbc-978100132bcb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:18.181612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 814/1628] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:18 2022] PUT /identity/v3/projects/424f44e462314b2e8c2af5616c0ae4c9/users/74d3f9373fa340edabf600cd96497019/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:18.186492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad89ad8-5a83-48df-a3ed-7ea27fcb5058 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:18.200856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad89ad8-5a83-48df-a3ed-7ea27fcb5058 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:18.331530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefd13f-b327-4977-a461-35817716bed3 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:18.331926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefd13f-b327-4977-a461-35817716bed3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:18.332316 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefd13f-b327-4977-a461-35817716bed3 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:18.334199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 815/1629] 10.222.0.44 () {54 vars in 912 bytes} [Fri Jun 24 10:32:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:32:18.346779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013721a-2a3e-457b-9c0e-b2c8b56f901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:18.347742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013721a-2a3e-457b-9c0e-b2c8b56f901d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:18.349472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006f064-41e4-45d1-ab02-33f960dc7628 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:18.349864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006f064-41e4-45d1-ab02-33f960dc7628 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:18.350312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006f064-41e4-45d1-ab02-33f960dc7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:18.356957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013721a-2a3e-457b-9c0e-b2c8b56f901d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:18.367182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013721a-2a3e-457b-9c0e-b2c8b56f901d admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:18.367182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013721a-2a3e-457b-9c0e-b2c8b56f901d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:18.374231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013721a-2a3e-457b-9c0e-b2c8b56f901d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:18.409592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2006f064-41e4-45d1-ab02-33f960dc7628 None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:18.412338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2006f064-41e4-45d1-ab02-33f960dc7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:18.413279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 815/1630] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:18.415008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7756-7126-4833-a6c3-999b67868b58 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:18.415313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7756-7126-4833-a6c3-999b67868b58 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:18.415599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7756-7126-4833-a6c3-999b67868b58 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:18.420585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 816/1631] 10.222.0.44 () {54 vars in 912 bytes} [Fri Jun 24 10:32:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:32:18.421397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d7756-7126-4833-a6c3-999b67868b58 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:18.457014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d7756-7126-4833-a6c3-999b67868b58 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:18.468811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8fad4-b56e-44df-9638-07594c94b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:18.471004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8fad4-b56e-44df-9638-07594c94b288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:18.471296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8fad4-b56e-44df-9638-07594c94b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:18.473741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8fad4-b56e-44df-9638-07594c94b288 admin admin] PATH_INFO: `/v3/projects/424f44e462314b2e8c2af5616c0ae4c9/users/74d3f9373fa340edabf600cd96497019/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:18.480839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8fad4-b56e-44df-9638-07594c94b288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=424f44e462314b2e8c2af5616c0ae4c9, user_id=74d3f9373fa340edabf600cd96497019, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:18.498967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8fad4-b56e-44df-9638-07594c94b288 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:18.530447 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 817/1632] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:18 2022] PUT /identity/v3/projects/424f44e462314b2e8c2af5616c0ae4c9/users/74d3f9373fa340edabf600cd96497019/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:18.538598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba66a-0550-474a-b378-028ade814e2e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:18.538895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba66a-0550-474a-b378-028ade814e2e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:18.540441 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba66a-0550-474a-b378-028ade814e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:18.576025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 816/1633] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:32:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:18.588137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0b8ba66a-0550-474a-b378-028ade814e2e None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:18.589396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0b8ba66a-0550-474a-b378-028ade814e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:18.595522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006f064-41e4-45d1-ab02-33f960dc7628 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:18.644793 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:18.695080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:18.707886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006f064-41e4-45d1-ab02-33f960dc7628 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:18.726911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 818/1634] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:32:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:18.741882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba66a-0550-474a-b378-028ade814e2e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:18.793958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d5f5-ca4c-4cc7-ac53-89dd55e8ea2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:18.794686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d5f5-ca4c-4cc7-ac53-89dd55e8ea2c service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:18.794958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d5f5-ca4c-4cc7-ac53-89dd55e8ea2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:18.795445 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d5f5-ca4c-4cc7-ac53-89dd55e8ea2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:18.815003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29d5f5-ca4c-4cc7-ac53-89dd55e8ea2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:18.818476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29d5f5-ca4c-4cc7-ac53-89dd55e8ea2c service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:18.834667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 817/1635] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:32:18.888147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba66a-0550-474a-b378-028ade814e2e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:18.901001 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2183811-721f-4f33-b644-5304b0dd8c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:18.901719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2183811-721f-4f33-b644-5304b0dd8c43 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:18.905182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2183811-721f-4f33-b644-5304b0dd8c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:18.905506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2183811-721f-4f33-b644-5304b0dd8c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:18.931634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2183811-721f-4f33-b644-5304b0dd8c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:18.940933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2183811-721f-4f33-b644-5304b0dd8c43 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:18.965107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 819/1636] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:19.298663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d5f5-ca4c-4cc7-ac53-89dd55e8ea2c service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:19.467578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d5f5-ca4c-4cc7-ac53-89dd55e8ea2c service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:19.483074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:19.483983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:19.484583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:19.484867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] PATH_INFO: `/v3/users/c15053da498b4b7d8646b1bc185de539` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:19.487830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15053da498b4b7d8646b1bc185de539)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:19.492743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:19.595067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15053da498b4b7d8646b1bc185de539'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:19.597745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15053da498b4b7d8646b1bc185de539'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:19.598515 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15053da498b4b7d8646b1bc185de539'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:19.647376 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15053da498b4b7d8646b1bc185de539'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:19.660875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15053da498b4b7d8646b1bc185de539'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:19.679075 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:19.689749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 818/1637] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:19 2022] DELETE /identity/v3/users/c15053da498b4b7d8646b1bc185de539 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:19.692033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298bbe8-c605-45b6-a18e-9c6ca37f1dfb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:19.692574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298bbe8-c605-45b6-a18e-9c6ca37f1dfb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:19.692574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298bbe8-c605-45b6-a18e-9c6ca37f1dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:19.740032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1298bbe8-c605-45b6-a18e-9c6ca37f1dfb None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:19.742029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1298bbe8-c605-45b6-a18e-9c6ca37f1dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:19.885551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 820/1638] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:19.981122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:19.983252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:20.072972 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d9327-2d67-449f-8e54-588b58317921 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:20.077586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f07e5-e32a-4722-89c1-7489f1536d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:20.078235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f07e5-e32a-4722-89c1-7489f1536d05 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:20.078599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f07e5-e32a-4722-89c1-7489f1536d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:20.078893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f07e5-e32a-4722-89c1-7489f1536d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:20.096247 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f07e5-e32a-4722-89c1-7489f1536d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:20.098762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f07e5-e32a-4722-89c1-7489f1536d05 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:20.118931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 819/1639] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:22.273033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f42ee0-e70c-4d08-9451-195a8127e3db None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:22.274166 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f42ee0-e70c-4d08-9451-195a8127e3db None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:22.274624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f42ee0-e70c-4d08-9451-195a8127e3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:22.313616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f07e5-e32a-4722-89c1-7489f1536d05 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:22.315391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1b9f07e5-e32a-4722-89c1-7489f1536d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:22.338307 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b9f42ee0-e70c-4d08-9451-195a8127e3db None None] MFA Rules not processed for user `74d3f9373fa340edabf600cd96497019`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:22.340912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b9f42ee0-e70c-4d08-9451-195a8127e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:22.341485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f07e5-e32a-4722-89c1-7489f1536d05 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:22.353193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:22.356030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:22.356338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:22.357906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] PATH_INFO: `/v3/projects/fa2deaeba2164ca6bee41ccd6cb59fa1` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:22.360886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2deaeba2164ca6bee41ccd6cb59fa1)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:22.362860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: WARNING py.warnings [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:32:22.362860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: warnings.warn(msg) Jun 24 10:32:22.362860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: Jun 24 10:32:22.367549 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:22.508731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2deaeba2164ca6bee41ccd6cb59fa1', 'request_id': 'req-c0557058-d026-4896-8a1e-eb7fc3e801ca'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:22.531714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2deaeba2164ca6bee41ccd6cb59fa1', 'request_id': 'req-c0557058-d026-4896-8a1e-eb7fc3e801ca'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:22.534995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 821/1640] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:22.539904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f42ee0-e70c-4d08-9451-195a8127e3db None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:22.541980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b9f42ee0-e70c-4d08-9451-195a8127e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:22.569614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2deaeba2164ca6bee41ccd6cb59fa1', 'request_id': 'req-c0557058-d026-4896-8a1e-eb7fc3e801ca'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:22.583606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f42ee0-e70c-4d08-9451-195a8127e3db None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:22.604491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] The token cache is being invalidate because project fa2deaeba2164ca6bee41ccd6cb59fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:22.604930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:22.605695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-c0557058-d026-4896-8a1e-eb7fc3e801ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:22.607816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 820/1641] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:22 2022] DELETE /identity/v3/projects/fa2deaeba2164ca6bee41ccd6cb59fa1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:22.614954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8360b6-4ccc-4999-b972-fe1383d2245d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:22.617005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8360b6-4ccc-4999-b972-fe1383d2245d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:22.617501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8360b6-4ccc-4999-b972-fe1383d2245d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:22.633478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:22.660946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7d8360b6-4ccc-4999-b972-fe1383d2245d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:22.664922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7d8360b6-4ccc-4999-b972-fe1383d2245d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:22.730376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:22.731400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:22.732932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:22.733314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] PATH_INFO: `/v3/users/7cd9fb385165490cb1b9ffb11dcb73a1` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:22.736841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd9fb385165490cb1b9ffb11dcb73a1)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:22.739830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: WARNING py.warnings [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:32:22.739830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: warnings.warn(msg) Jun 24 10:32:22.739830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: Jun 24 10:32:22.798679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:22.821088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 821/1642] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:22.830575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14151cdf-e03d-44f8-9ef8-bc93ea751263 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:22.831583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14151cdf-e03d-44f8-9ef8-bc93ea751263 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:22.835287 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14151cdf-e03d-44f8-9ef8-bc93ea751263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:22.888362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-14151cdf-e03d-44f8-9ef8-bc93ea751263 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:22.888626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-14151cdf-e03d-44f8-9ef8-bc93ea751263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:22.915201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 822/1643] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:22.916562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14151cdf-e03d-44f8-9ef8-bc93ea751263 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:22.932900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14151cdf-e03d-44f8-9ef8-bc93ea751263 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:22.946980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17193378-604b-4251-a001-e5e45f39fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:22.947760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17193378-604b-4251-a001-e5e45f39fec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:22.948339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17193378-604b-4251-a001-e5e45f39fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:22.948663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17193378-604b-4251-a001-e5e45f39fec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:22.949407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17193378-604b-4251-a001-e5e45f39fec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:22.949715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17193378-604b-4251-a001-e5e45f39fec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:22.950994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd9fb385165490cb1b9ffb11dcb73a1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:22.951393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17193378-604b-4251-a001-e5e45f39fec6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:22.952111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd9fb385165490cb1b9ffb11dcb73a1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:22.969669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd9fb385165490cb1b9ffb11dcb73a1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:22.982226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 823/1644] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:22.987762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17193378-604b-4251-a001-e5e45f39fec6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:22.999031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:23.005598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17193378-604b-4251-a001-e5e45f39fec6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:23.023343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9d9e1-c5fd-4be8-8db4-a214d6e54ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:23.026998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d9e1-c5fd-4be8-8db4-a214d6e54ced admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:23.027285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d9e1-c5fd-4be8-8db4-a214d6e54ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:23.027564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d9e1-c5fd-4be8-8db4-a214d6e54ced admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:23.028276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9d9e1-c5fd-4be8-8db4-a214d6e54ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:23.030206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9d9e1-c5fd-4be8-8db4-a214d6e54ced admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:23.035900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd9fb385165490cb1b9ffb11dcb73a1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:23.065068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-930755d7-537e-4aa4-895c-a1f05af641a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd9fb385165490cb1b9ffb11dcb73a1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:23.086802 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 822/1645] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:22 2022] DELETE /identity/v3/users/7cd9fb385165490cb1b9ffb11dcb73a1 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:23.092711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a623c-2ec3-47d1-9d5e-b67300921410 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:23.094860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a623c-2ec3-47d1-9d5e-b67300921410 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:23.095886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a623c-2ec3-47d1-9d5e-b67300921410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:23.097968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 824/1646] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:22 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:32:23.098905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9d9e1-c5fd-4be8-8db4-a214d6e54ced admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:23.112002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-efc9d9e1-c5fd-4be8-8db4-a214d6e54ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:23.145745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fe5a623c-2ec3-47d1-9d5e-b67300921410 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:23.149398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fe5a623c-2ec3-47d1-9d5e-b67300921410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:23.241041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9d9e1-c5fd-4be8-8db4-a214d6e54ced admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:23.251754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd45f20-54b9-4be7-a11e-bf8c622998e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:23.253752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd45f20-54b9-4be7-a11e-bf8c622998e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:23.254223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd45f20-54b9-4be7-a11e-bf8c622998e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:23.254696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd45f20-54b9-4be7-a11e-bf8c622998e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:23.256004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd45f20-54b9-4be7-a11e-bf8c622998e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:23.258347 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd45f20-54b9-4be7-a11e-bf8c622998e0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:23.304181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 825/1647] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:23 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:23.308307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd45f20-54b9-4be7-a11e-bf8c622998e0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:23.310735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 823/1648] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:23.330003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd45f20-54b9-4be7-a11e-bf8c622998e0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:23.342757 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b7f1a-30d9-4986-9b8f-2daaa9067cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:23.343457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b7f1a-30d9-4986-9b8f-2daaa9067cde admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:23.345407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b7f1a-30d9-4986-9b8f-2daaa9067cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:23.345628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b7f1a-30d9-4986-9b8f-2daaa9067cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:23.346433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b7f1a-30d9-4986-9b8f-2daaa9067cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:23.349421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b7f1a-30d9-4986-9b8f-2daaa9067cde admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:23.366002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 826/1649] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:23.370080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a623c-2ec3-47d1-9d5e-b67300921410 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:23.377038 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b7f1a-30d9-4986-9b8f-2daaa9067cde admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:23.379811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-986b7f1a-30d9-4986-9b8f-2daaa9067cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:23.384562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a623c-2ec3-47d1-9d5e-b67300921410 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:23.397873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffa66-9297-4823-8432-ef7d5fd0c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:23.398598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffa66-9297-4823-8432-ef7d5fd0c4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:23.398886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffa66-9297-4823-8432-ef7d5fd0c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:23.399174 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffa66-9297-4823-8432-ef7d5fd0c4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:23.399919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ffa66-9297-4823-8432-ef7d5fd0c4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:23.401577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ffa66-9297-4823-8432-ef7d5fd0c4f6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:23.441818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 824/1650] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:23.447369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffa66-9297-4823-8432-ef7d5fd0c4f6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:23.471154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffa66-9297-4823-8432-ef7d5fd0c4f6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:23.484713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35b5a4-1912-4851-8451-e6093034620f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:23.485650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35b5a4-1912-4851-8451-e6093034620f admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:23.485934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35b5a4-1912-4851-8451-e6093034620f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:23.486214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35b5a4-1912-4851-8451-e6093034620f admin admin] PATH_INFO: `/v3/projects/792348f574f74637bbcfd06e9d202e34/users/b25b24d66c354b78a1cd71b0b72f9c66/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:23.532018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b7f1a-30d9-4986-9b8f-2daaa9067cde admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:23.539114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35b5a4-1912-4851-8451-e6093034620f admin admin] RBAC: Authorizing `identity:create_grant(project_id=792348f574f74637bbcfd06e9d202e34, user_id=b25b24d66c354b78a1cd71b0b72f9c66, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:23.542215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35b5a4-1912-4851-8451-e6093034620f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:23.547030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a864-05f9-4ed0-a5a3-f42d8b9806a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:23.548801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a864-05f9-4ed0-a5a3-f42d8b9806a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:23.549525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a864-05f9-4ed0-a5a3-f42d8b9806a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:23.550746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a864-05f9-4ed0-a5a3-f42d8b9806a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:23.578526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5a864-05f9-4ed0-a5a3-f42d8b9806a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:23.582771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5a864-05f9-4ed0-a5a3-f42d8b9806a1 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:23.597505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 825/1651] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:23 2022] PUT /identity/v3/projects/792348f574f74637bbcfd06e9d202e34/users/b25b24d66c354b78a1cd71b0b72f9c66/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:32:23.602996 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c776-51cb-4fe0-8634-79dd7217156e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:23.603294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c776-51cb-4fe0-8634-79dd7217156e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:23.603578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c776-51cb-4fe0-8634-79dd7217156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:23.612716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:23.623464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 827/1652] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:32:23.651329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c458c776-51cb-4fe0-8634-79dd7217156e None None] MFA Rules not processed for user `b25b24d66c354b78a1cd71b0b72f9c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:23.653804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c458c776-51cb-4fe0-8634-79dd7217156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:23.787561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 826/1653] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:23.793587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a864-05f9-4ed0-a5a3-f42d8b9806a1 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:23.817906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a864-05f9-4ed0-a5a3-f42d8b9806a1 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:24.016226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676b97a-0053-4422-88a3-65d7adcb6ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:24.018815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676b97a-0053-4422-88a3-65d7adcb6ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:24.019330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676b97a-0053-4422-88a3-65d7adcb6ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:24.020761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676b97a-0053-4422-88a3-65d7adcb6ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:24.022296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676b97a-0053-4422-88a3-65d7adcb6ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:24.034581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676b97a-0053-4422-88a3-65d7adcb6ef8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:24.060338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:24.099009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 828/1654] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:23 2022] POST /identity/v3/projects => generated 373 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:24.103823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458c776-51cb-4fe0-8634-79dd7217156e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:24.117044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458c776-51cb-4fe0-8634-79dd7217156e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:24.214918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3843f1-b893-416a-b2c2-78fac48f953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:24.216078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3843f1-b893-416a-b2c2-78fac48f953b admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:24.216491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3843f1-b893-416a-b2c2-78fac48f953b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:24.216932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3843f1-b893-416a-b2c2-78fac48f953b admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:24.217764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3843f1-b893-416a-b2c2-78fac48f953b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:24.220644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3843f1-b893-416a-b2c2-78fac48f953b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:24.264957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676b97a-0053-4422-88a3-65d7adcb6ef8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:24.265430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 827/1655] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:24 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:32:24.279048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676b97a-0053-4422-88a3-65d7adcb6ef8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:24.289206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb0a1a-2c44-475b-998d-ddf2f81ad090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:24.289961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb0a1a-2c44-475b-998d-ddf2f81ad090 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:24.290261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb0a1a-2c44-475b-998d-ddf2f81ad090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:24.290566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb0a1a-2c44-475b-998d-ddf2f81ad090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:24.291396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb0a1a-2c44-475b-998d-ddf2f81ad090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:24.293990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb0a1a-2c44-475b-998d-ddf2f81ad090 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:24.314662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3843f1-b893-416a-b2c2-78fac48f953b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:24.324923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 829/1656] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:32:24.330484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3843f1-b893-416a-b2c2-78fac48f953b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:24.337724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b813f-2627-43da-93ab-9e2ab9fe8ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:24.339138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b813f-2627-43da-93ab-9e2ab9fe8ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:24.341643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b813f-2627-43da-93ab-9e2ab9fe8ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:24.342325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b813f-2627-43da-93ab-9e2ab9fe8ab6 admin admin] PATH_INFO: `/v3/projects/707403b5e0f5488bb2564e690bf05d4f/users/38cd8d35aa9241d4a597a5f58e306029/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:24.395185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b813f-2627-43da-93ab-9e2ab9fe8ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707403b5e0f5488bb2564e690bf05d4f, user_id=38cd8d35aa9241d4a597a5f58e306029, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:24.399138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b813f-2627-43da-93ab-9e2ab9fe8ab6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:24.423024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 828/1657] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:24 2022] PUT /identity/v3/projects/707403b5e0f5488bb2564e690bf05d4f/users/38cd8d35aa9241d4a597a5f58e306029/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:24.428349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb0a1a-2c44-475b-998d-ddf2f81ad090 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:24.449245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb0a1a-2c44-475b-998d-ddf2f81ad090 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:24.593553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a43ec-ffa6-4e5b-bf5a-3ca807cd1357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:24.594633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a43ec-ffa6-4e5b-bf5a-3ca807cd1357 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:24.595114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a43ec-ffa6-4e5b-bf5a-3ca807cd1357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:24.597732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a43ec-ffa6-4e5b-bf5a-3ca807cd1357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:24.601294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a43ec-ffa6-4e5b-bf5a-3ca807cd1357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:24.607282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a43ec-ffa6-4e5b-bf5a-3ca807cd1357 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:24.649668 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 830/1658] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:24.653672 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b813f-2627-43da-93ab-9e2ab9fe8ab6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:24.669184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b813f-2627-43da-93ab-9e2ab9fe8ab6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:24.675297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d62e9-f5fe-46b1-8b21-f72a71943705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:24.676132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d62e9-f5fe-46b1-8b21-f72a71943705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:24.676428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d62e9-f5fe-46b1-8b21-f72a71943705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:24.676714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d62e9-f5fe-46b1-8b21-f72a71943705 admin admin] PATH_INFO: `/v3/projects/707403b5e0f5488bb2564e690bf05d4f/users/38cd8d35aa9241d4a597a5f58e306029/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:24.679576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d62e9-f5fe-46b1-8b21-f72a71943705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707403b5e0f5488bb2564e690bf05d4f, user_id=38cd8d35aa9241d4a597a5f58e306029, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:24.685321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d62e9-f5fe-46b1-8b21-f72a71943705 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:24.704677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 829/1659] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:24 2022] PUT /identity/v3/projects/707403b5e0f5488bb2564e690bf05d4f/users/38cd8d35aa9241d4a597a5f58e306029/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:24.718742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c813d-b26f-42b3-a46a-3286a224d129 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:24.719347 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c813d-b26f-42b3-a46a-3286a224d129 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:24.719819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c813d-b26f-42b3-a46a-3286a224d129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:24.783223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-263c813d-b26f-42b3-a46a-3286a224d129 None None] MFA Rules not processed for user `38cd8d35aa9241d4a597a5f58e306029`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:24.788592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-263c813d-b26f-42b3-a46a-3286a224d129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:24.883145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5cd9-ceb3-4b9a-891d-a5f9bc299275 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:24.883145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5cd9-ceb3-4b9a-891d-a5f9bc299275 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:24.883371 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5cd9-ceb3-4b9a-891d-a5f9bc299275 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:24.885023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 830/1660] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:32:24.908478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf30e1-13da-41f6-b223-7aca8c6f7803 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:24.908766 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf30e1-13da-41f6-b223-7aca8c6f7803 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:24.909748 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf30e1-13da-41f6-b223-7aca8c6f7803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:24.952893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-10cf30e1-13da-41f6-b223-7aca8c6f7803 None None] MFA Rules not processed for user `06d6f1eebcfa48349613455eb5d2aaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:24.968721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-10cf30e1-13da-41f6-b223-7aca8c6f7803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:24.973642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 831/1661] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:25.004793 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c813d-b26f-42b3-a46a-3286a224d129 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:25.007033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-263c813d-b26f-42b3-a46a-3286a224d129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:25.095977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:25.137624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c813d-b26f-42b3-a46a-3286a224d129 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:25.144535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 831/1662] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:32:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:25.149554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243853b-29ae-492f-9225-ba2951fd152c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:25.150498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243853b-29ae-492f-9225-ba2951fd152c service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:25.163672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243853b-29ae-492f-9225-ba2951fd152c service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:25.164166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243853b-29ae-492f-9225-ba2951fd152c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:25.173605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c37c-7330-4b18-a6f4-d3af18e9b1b5 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:25.173897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c37c-7330-4b18-a6f4-d3af18e9b1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:25.174183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c37c-7330-4b18-a6f4-d3af18e9b1b5 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:25.176161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 832/1663] 10.222.0.44 () {54 vars in 960 bytes} [Fri Jun 24 10:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:32:25.181424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ce25-6345-4c3c-aa21-8e76d91b3923 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:25.181721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ce25-6345-4c3c-aa21-8e76d91b3923 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:25.181995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ce25-6345-4c3c-aa21-8e76d91b3923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:25.194098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243853b-29ae-492f-9225-ba2951fd152c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:25.194976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243853b-29ae-492f-9225-ba2951fd152c service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:25.219511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2694ce25-6345-4c3c-aa21-8e76d91b3923 None None] MFA Rules not processed for user `06d6f1eebcfa48349613455eb5d2aaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:25.220760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2694ce25-6345-4c3c-aa21-8e76d91b3923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:25.221556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 832/1664] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:25.239001 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 833/1665] 10.222.0.44 () {58 vars in 1057 bytes} [Fri Jun 24 10:32:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:25.248955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243853b-29ae-492f-9225-ba2951fd152c service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:25.255556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:25.274652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243853b-29ae-492f-9225-ba2951fd152c service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:25.285398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5dfc5-2e27-4b44-8136-4946e640db1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:25.286221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5dfc5-2e27-4b44-8136-4946e640db1a service placement] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:25.286565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5dfc5-2e27-4b44-8136-4946e640db1a service placement] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:25.286814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5dfc5-2e27-4b44-8136-4946e640db1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:25.341302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5dfc5-2e27-4b44-8136-4946e640db1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:25.343659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5dfc5-2e27-4b44-8136-4946e640db1a service placement] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:25.366461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 833/1666] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:25.835496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694ce25-6345-4c3c-aa21-8e76d91b3923 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:25.837031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2694ce25-6345-4c3c-aa21-8e76d91b3923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:26.016914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694ce25-6345-4c3c-aa21-8e76d91b3923 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:26.039244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:26.042064 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:26.042064 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:26.042064 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] PATH_INFO: `/v3/projects/2074a2921b4442b09da2c325559ee583` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:26.051721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2074a2921b4442b09da2c325559ee583)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:26.054019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:26.192899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2074a2921b4442b09da2c325559ee583', 'request_id': 'req-b1db715a-0f8b-42e6-af9e-5e4617886647'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:26.212225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2074a2921b4442b09da2c325559ee583', 'request_id': 'req-b1db715a-0f8b-42e6-af9e-5e4617886647'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:26.219913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2074a2921b4442b09da2c325559ee583', 'request_id': 'req-b1db715a-0f8b-42e6-af9e-5e4617886647'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:26.259604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5dfc5-2e27-4b44-8136-4946e640db1a service placement] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:26.267974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] The token cache is being invalidate because project 2074a2921b4442b09da2c325559ee583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:26.268274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:26.269988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1db715a-0f8b-42e6-af9e-5e4617886647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:26.276124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 834/1667] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:25 2022] DELETE /identity/v3/projects/2074a2921b4442b09da2c325559ee583 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:26.282828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5dfc5-2e27-4b44-8136-4946e640db1a service placement] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:26.284598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cfe7-9718-4176-bd45-5210b03f3dde None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:26.284825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cfe7-9718-4176-bd45-5210b03f3dde None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:26.285077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cfe7-9718-4176-bd45-5210b03f3dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:26.336707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f124cfe7-9718-4176-bd45-5210b03f3dde None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:26.342489 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f124cfe7-9718-4176-bd45-5210b03f3dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:26.435256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:26.436837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:26.437126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:26.437407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] PATH_INFO: `/v3/users/b25b24d66c354b78a1cd71b0b72f9c66` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:26.442821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25b24d66c354b78a1cd71b0b72f9c66)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:26.447278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:26.486141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 835/1668] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:26.503287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961673-7d5a-4ad7-88b5-645ff263a40b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:26.503622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961673-7d5a-4ad7-88b5-645ff263a40b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:26.503915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961673-7d5a-4ad7-88b5-645ff263a40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:26.523858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:26.546393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d4961673-7d5a-4ad7-88b5-645ff263a40b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:26.553273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d4961673-7d5a-4ad7-88b5-645ff263a40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:26.595185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 836/1669] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:26.601444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5aea2-df47-4438-8f2b-0be6dcbeb9ee None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:26.601970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5aea2-df47-4438-8f2b-0be6dcbeb9ee None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:26.602425 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5aea2-df47-4438-8f2b-0be6dcbeb9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:26.648639 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25b24d66c354b78a1cd71b0b72f9c66'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:26.665018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25b24d66c354b78a1cd71b0b72f9c66'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:26.666025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25b24d66c354b78a1cd71b0b72f9c66'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:26.677462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d1b5aea2-df47-4438-8f2b-0be6dcbeb9ee None None] MFA Rules not processed for user `4fc4ced89bd741f7ac92e5a5a2dc6653`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:26.678728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d1b5aea2-df47-4438-8f2b-0be6dcbeb9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:26.704267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25b24d66c354b78a1cd71b0b72f9c66'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:26.716619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25b24d66c354b78a1cd71b0b72f9c66'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:26.741886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 834/1670] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:26 2022] DELETE /identity/v3/users/b25b24d66c354b78a1cd71b0b72f9c66 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:32:26.745057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:26.753116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:26.839981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 837/1671] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:26.847667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164143-4953-46b5-8d56-2ecabae3fff5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:26.847922 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164143-4953-46b5-8d56-2ecabae3fff5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:26.848193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164143-4953-46b5-8d56-2ecabae3fff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:26.884811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dd164143-4953-46b5-8d56-2ecabae3fff5 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:26.887658 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dd164143-4953-46b5-8d56-2ecabae3fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:26.907466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 838/1672] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:26.910212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bce81-fac6-4407-8251-aa69592e122f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:26.911491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61fdd0-8d1c-4c65-818a-72aa6ac9d7f5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:26.912318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61fdd0-8d1c-4c65-818a-72aa6ac9d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:26.912604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61fdd0-8d1c-4c65-818a-72aa6ac9d7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:26.919663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd7d08-2977-4cbd-a410-f0bfccc70a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:26.923767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7d08-2977-4cbd-a410-f0bfccc70a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:26.923940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7d08-2977-4cbd-a410-f0bfccc70a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:26.924187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd7d08-2977-4cbd-a410-f0bfccc70a7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:26.924995 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd7d08-2977-4cbd-a410-f0bfccc70a7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:26.925322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd7d08-2977-4cbd-a410-f0bfccc70a7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:26.931328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd7d08-2977-4cbd-a410-f0bfccc70a7e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:26.955860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6a61fdd0-8d1c-4c65-818a-72aa6ac9d7f5 None None] MFA Rules not processed for user `4fc4ced89bd741f7ac92e5a5a2dc6653`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:26.957888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6a61fdd0-8d1c-4c65-818a-72aa6ac9d7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:26.966727 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 835/1673] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:26.967591 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd7d08-2977-4cbd-a410-f0bfccc70a7e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:26.972091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-70bd7d08-2977-4cbd-a410-f0bfccc70a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:26.985331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:27.093458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 839/1674] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:27.094930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61fdd0-8d1c-4c65-818a-72aa6ac9d7f5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:27.107986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd7d08-2977-4cbd-a410-f0bfccc70a7e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:27.112519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3141-ea09-4d5f-9227-9e868f53205e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:27.113312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3141-ea09-4d5f-9227-9e868f53205e service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:27.113416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3141-ea09-4d5f-9227-9e868f53205e service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:27.113632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f3141-ea09-4d5f-9227-9e868f53205e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:27.123524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61fdd0-8d1c-4c65-818a-72aa6ac9d7f5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:27.124857 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3141-ea09-4d5f-9227-9e868f53205e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:27.126871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f3141-ea09-4d5f-9227-9e868f53205e service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:27.136559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce62e2-59fd-4e34-b8b3-ea309149d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:27.137249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce62e2-59fd-4e34-b8b3-ea309149d2fd admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:27.137533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce62e2-59fd-4e34-b8b3-ea309149d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:27.137811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce62e2-59fd-4e34-b8b3-ea309149d2fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:27.138563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce62e2-59fd-4e34-b8b3-ea309149d2fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:27.140545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce62e2-59fd-4e34-b8b3-ea309149d2fd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:27.153103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 836/1675] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:27.154394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3141-ea09-4d5f-9227-9e868f53205e service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:27.163699 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-776f3141-ea09-4d5f-9227-9e868f53205e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:27.201910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 840/1676] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:27 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:27.207010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce62e2-59fd-4e34-b8b3-ea309149d2fd admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:27.349120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce62e2-59fd-4e34-b8b3-ea309149d2fd admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:27.349592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f3141-ea09-4d5f-9227-9e868f53205e service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:27.357524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20071b-2e8a-4090-b2b2-f8f3befcc24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:27.358914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20071b-2e8a-4090-b2b2-f8f3befcc24a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:27.359684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20071b-2e8a-4090-b2b2-f8f3befcc24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:27.360159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20071b-2e8a-4090-b2b2-f8f3befcc24a admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:27.361682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20071b-2e8a-4090-b2b2-f8f3befcc24a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:27.364521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20071b-2e8a-4090-b2b2-f8f3befcc24a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:27.383273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:27.412378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 841/1677] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:27 2022] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:32:27.413689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20071b-2e8a-4090-b2b2-f8f3befcc24a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:27.428380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20071b-2e8a-4090-b2b2-f8f3befcc24a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:27.441906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81c802-fa7f-429c-9274-eb9dd0df9e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:27.442952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81c802-fa7f-429c-9274-eb9dd0df9e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:27.443437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81c802-fa7f-429c-9274-eb9dd0df9e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:27.443909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81c802-fa7f-429c-9274-eb9dd0df9e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:27.444849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81c802-fa7f-429c-9274-eb9dd0df9e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:27.448238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81c802-fa7f-429c-9274-eb9dd0df9e16 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:27.484934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 842/1678] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:27.488073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81c802-fa7f-429c-9274-eb9dd0df9e16 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:27.510839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81c802-fa7f-429c-9274-eb9dd0df9e16 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:27.522187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a2c4-4cbb-4e7d-b0fb-3a4ab8474eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:27.522910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a2c4-4cbb-4e7d-b0fb-3a4ab8474eab admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:27.523194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a2c4-4cbb-4e7d-b0fb-3a4ab8474eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:27.523467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a2c4-4cbb-4e7d-b0fb-3a4ab8474eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:27.524714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a2c4-4cbb-4e7d-b0fb-3a4ab8474eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:27.525925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a2c4-4cbb-4e7d-b0fb-3a4ab8474eab admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:27.553952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 843/1679] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:27.559602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a2c4-4cbb-4e7d-b0fb-3a4ab8474eab admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:27.571904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39f4a8-f381-4190-bbd9-281029013148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:27.576928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39f4a8-f381-4190-bbd9-281029013148 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:27.578564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39f4a8-f381-4190-bbd9-281029013148 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:27.579635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39f4a8-f381-4190-bbd9-281029013148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:27.584163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a2c4-4cbb-4e7d-b0fb-3a4ab8474eab admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:27.595523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e8cdc-2c40-42b8-94dd-6b7743ef7c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:27.596487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e8cdc-2c40-42b8-94dd-6b7743ef7c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:27.597338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e8cdc-2c40-42b8-94dd-6b7743ef7c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:27.597616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e8cdc-2c40-42b8-94dd-6b7743ef7c0d admin admin] PATH_INFO: `/v3/projects/2b30d0a6fca149e792bf5f3f9ff60479/users/5fcd6b147a8146c4bd7674c9284d3ee0/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:27.638650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e8cdc-2c40-42b8-94dd-6b7743ef7c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b30d0a6fca149e792bf5f3f9ff60479, user_id=5fcd6b147a8146c4bd7674c9284d3ee0, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:27.641380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e8cdc-2c40-42b8-94dd-6b7743ef7c0d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:27.677595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 844/1680] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:27 2022] PUT /identity/v3/projects/2b30d0a6fca149e792bf5f3f9ff60479/users/5fcd6b147a8146c4bd7674c9284d3ee0/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:27.679256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cf7ef-dd58-4e7e-90e9-29305ccf7af5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:27.679606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cf7ef-dd58-4e7e-90e9-29305ccf7af5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:27.679889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cf7ef-dd58-4e7e-90e9-29305ccf7af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:27.683873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:27.733579 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39f4a8-f381-4190-bbd9-281029013148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:27.735571 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39f4a8-f381-4190-bbd9-281029013148 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:27.741076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-257cf7ef-dd58-4e7e-90e9-29305ccf7af5 None None] MFA Rules not processed for user `5fcd6b147a8146c4bd7674c9284d3ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:27.742717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-257cf7ef-dd58-4e7e-90e9-29305ccf7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:27.762064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 837/1681] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:27.914757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 845/1682] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:27.924026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39f4a8-f381-4190-bbd9-281029013148 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:27.925630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3e39f4a8-f381-4190-bbd9-281029013148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:28.085248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39f4a8-f381-4190-bbd9-281029013148 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:28.160791 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fa731-9e2e-49f8-ba08-e1d15a91d851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:28.161454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fa731-9e2e-49f8-ba08-e1d15a91d851 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:28.162422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fa731-9e2e-49f8-ba08-e1d15a91d851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:28.162718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fa731-9e2e-49f8-ba08-e1d15a91d851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:28.177216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fa731-9e2e-49f8-ba08-e1d15a91d851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:28.179873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fa731-9e2e-49f8-ba08-e1d15a91d851 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:28.193904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 838/1683] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:28.654325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cf7ef-dd58-4e7e-90e9-29305ccf7af5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:28.655862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-257cf7ef-dd58-4e7e-90e9-29305ccf7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:28.873401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cf7ef-dd58-4e7e-90e9-29305ccf7af5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:28.888668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:28.890173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:28.890732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:28.891151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] PATH_INFO: `/v3/projects/792348f574f74637bbcfd06e9d202e34` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:28.894290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=792348f574f74637bbcfd06e9d202e34)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:28.900487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:29.046076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:29.065089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792348f574f74637bbcfd06e9d202e34', 'request_id': 'req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.085410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792348f574f74637bbcfd06e9d202e34', 'request_id': 'req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.104012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792348f574f74637bbcfd06e9d202e34', 'request_id': 'req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.122222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] The token cache is being invalidate because project 792348f574f74637bbcfd06e9d202e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:29.123737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.124653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-686eef6b-2c7a-477f-b2b7-bfd6e3f83f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.128830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 846/1684] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:28 2022] DELETE /identity/v3/projects/792348f574f74637bbcfd06e9d202e34 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:29.132220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fa731-9e2e-49f8-ba08-e1d15a91d851 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:29.147545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fa731-9e2e-49f8-ba08-e1d15a91d851 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:29.233301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd573e13-5fc0-4057-95b5-00535d5f1ef2 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:29.233709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd573e13-5fc0-4057-95b5-00535d5f1ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:29.234115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd573e13-5fc0-4057-95b5-00535d5f1ef2 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:29.237068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 847/1685] 10.222.0.44 () {54 vars in 912 bytes} [Fri Jun 24 10:32:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:32:29.242953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941a75c-4f22-44ed-bc32-ab9396f19bfd None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:29.243323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941a75c-4f22-44ed-bc32-ab9396f19bfd None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:29.243710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941a75c-4f22-44ed-bc32-ab9396f19bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:29.253926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:29.265114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:29.265506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:29.266218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] PATH_INFO: `/v3/users/38cd8d35aa9241d4a597a5f58e306029` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:29.271761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=38cd8d35aa9241d4a597a5f58e306029)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:29.277775 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:29.340009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2941a75c-4f22-44ed-bc32-ab9396f19bfd None None] MFA Rules not processed for user `4160318c1b9b49539c6a2d8110289463`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:29.341510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2941a75c-4f22-44ed-bc32-ab9396f19bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:29.354026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:29.361466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38cd8d35aa9241d4a597a5f58e306029'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.375585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38cd8d35aa9241d4a597a5f58e306029'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.376340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38cd8d35aa9241d4a597a5f58e306029'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.431769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38cd8d35aa9241d4a597a5f58e306029'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.445664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38cd8d35aa9241d4a597a5f58e306029'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.468611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 848/1686] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:32:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:29.469814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6540a-29bf-46b2-ad76-cf9e630249f5 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:29.470213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6540a-29bf-46b2-ad76-cf9e630249f5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:29.470662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6540a-29bf-46b2-ad76-cf9e630249f5 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:29.474806 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 849/1687] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:32:29.496243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 839/1688] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:29 2022] DELETE /identity/v3/users/38cd8d35aa9241d4a597a5f58e306029 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:29.516136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6540a-29bf-46b2-ad76-cf9e630249f5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:29.518223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-10b6540a-29bf-46b2-ad76-cf9e630249f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:29.605159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:29.606808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:29.631495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6540a-29bf-46b2-ad76-cf9e630249f5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:29.641747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb15c8b-e1ed-41a6-882c-728ece78ab16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:29.642225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb15c8b-e1ed-41a6-882c-728ece78ab16 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:29.642439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb15c8b-e1ed-41a6-882c-728ece78ab16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:29.643702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb15c8b-e1ed-41a6-882c-728ece78ab16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:29.676168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb15c8b-e1ed-41a6-882c-728ece78ab16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:29.677814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb15c8b-e1ed-41a6-882c-728ece78ab16 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:29.696537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 850/1689] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:32:29.698308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cc9d0-eb67-4f73-bb7b-4716a4130845 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:29.698627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cc9d0-eb67-4f73-bb7b-4716a4130845 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:29.701007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cc9d0-eb67-4f73-bb7b-4716a4130845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:29.723461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fd6cc9d0-eb67-4f73-bb7b-4716a4130845 None None] MFA Rules not processed for user `06d6f1eebcfa48349613455eb5d2aaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:29.724704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fd6cc9d0-eb67-4f73-bb7b-4716a4130845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:29.768504 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab08fe-6531-47f4-ad5a-fb426d4501ec admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:29.779449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:29.780359 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:29.780645 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:29.781000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] PATH_INFO: `/v3/users/27e9316df1754d7e9938cb2f0af7edd3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:29.783749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e9316df1754d7e9938cb2f0af7edd3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:29.787560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:29.811814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 851/1690] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:32:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:29.852133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cc9d0-eb67-4f73-bb7b-4716a4130845 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:29.854770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fd6cc9d0-eb67-4f73-bb7b-4716a4130845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:29.871367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:29.879385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cc9d0-eb67-4f73-bb7b-4716a4130845 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:29.893467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996a959-1d0c-412f-ab26-873df6f6432b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:29.894192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996a959-1d0c-412f-ab26-873df6f6432b service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:29.894521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996a959-1d0c-412f-ab26-873df6f6432b service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:29.894798 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996a959-1d0c-412f-ab26-873df6f6432b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:29.909598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e9316df1754d7e9938cb2f0af7edd3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.912232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e9316df1754d7e9938cb2f0af7edd3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.913171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e9316df1754d7e9938cb2f0af7edd3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.916654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996a959-1d0c-412f-ab26-873df6f6432b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:29.918225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996a959-1d0c-412f-ab26-873df6f6432b service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:29.941980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 852/1691] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:32:29.961224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e9316df1754d7e9938cb2f0af7edd3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:29.985286 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ea665ded-468a-4f69-8a76-f358301dcdc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e9316df1754d7e9938cb2f0af7edd3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:30.010416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 840/1692] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:29 2022] DELETE /identity/v3/users/27e9316df1754d7e9938cb2f0af7edd3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:31.046471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996a959-1d0c-412f-ab26-873df6f6432b service placement] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:31.048487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5996a959-1d0c-412f-ab26-873df6f6432b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:31.071528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996a959-1d0c-412f-ab26-873df6f6432b service placement] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:31.198014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:31.199382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:31.199949 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:31.200438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] PATH_INFO: `/v3/projects/707403b5e0f5488bb2564e690bf05d4f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:31.204058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=707403b5e0f5488bb2564e690bf05d4f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:31.206556 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:31.318691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707403b5e0f5488bb2564e690bf05d4f', 'request_id': 'req-eb97975f-ac72-411c-89ce-596e763ab791'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:31.338263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707403b5e0f5488bb2564e690bf05d4f', 'request_id': 'req-eb97975f-ac72-411c-89ce-596e763ab791'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:31.344785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707403b5e0f5488bb2564e690bf05d4f', 'request_id': 'req-eb97975f-ac72-411c-89ce-596e763ab791'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:31.371207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] The token cache is being invalidate because project 707403b5e0f5488bb2564e690bf05d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:31.371584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:31.372575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:31.382874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 853/1693] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:31 2022] DELETE /identity/v3/projects/707403b5e0f5488bb2564e690bf05d4f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:31.384686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d819f-7508-427c-928b-63363a9b5c39 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:31.385148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d819f-7508-427c-928b-63363a9b5c39 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:31.385234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d819f-7508-427c-928b-63363a9b5c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:31.390440 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:31.391968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:31.427327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-650d819f-7508-427c-928b-63363a9b5c39 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:31.428676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-650d819f-7508-427c-928b-63363a9b5c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:31.510943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:31.552145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97975f-ac72-411c-89ce-596e763ab791 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:31.593122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43666d-b1c3-4599-a169-519ec39658a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:31.593817 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43666d-b1c3-4599-a169-519ec39658a2 service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:31.594098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43666d-b1c3-4599-a169-519ec39658a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:31.594429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43666d-b1c3-4599-a169-519ec39658a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:31.598705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3a43666d-b1c3-4599-a169-519ec39658a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:31.604780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 841/1694] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:31.613189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43666d-b1c3-4599-a169-519ec39658a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:31.615757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43666d-b1c3-4599-a169-519ec39658a2 service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:31.619480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e1cc-36ab-49b9-8079-34dcaba09f46 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:31.619770 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e1cc-36ab-49b9-8079-34dcaba09f46 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:31.620051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e1cc-36ab-49b9-8079-34dcaba09f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:31.639040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 854/1695] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:32:31.679742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-afb7e1cc-36ab-49b9-8079-34dcaba09f46 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:31.681783 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-afb7e1cc-36ab-49b9-8079-34dcaba09f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:31.705577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 842/1696] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:31.705933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43666d-b1c3-4599-a169-519ec39658a2 service placement] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:31.719872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43666d-b1c3-4599-a169-519ec39658a2 service placement] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:31.738533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d65ac-c827-4eeb-9bfa-8593a618cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:31.739216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d65ac-c827-4eeb-9bfa-8593a618cdec admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:31.739504 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d65ac-c827-4eeb-9bfa-8593a618cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:31.739873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d65ac-c827-4eeb-9bfa-8593a618cdec admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:31.740536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d65ac-c827-4eeb-9bfa-8593a618cdec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:31.740810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d65ac-c827-4eeb-9bfa-8593a618cdec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:31.742500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d65ac-c827-4eeb-9bfa-8593a618cdec admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:31.754591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:31.791498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 855/1697] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:31.793157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7e1cc-36ab-49b9-8079-34dcaba09f46 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:31.807390 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d65ac-c827-4eeb-9bfa-8593a618cdec admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:31.809671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-387d65ac-c827-4eeb-9bfa-8593a618cdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:31.811509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7e1cc-36ab-49b9-8079-34dcaba09f46 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:31.832661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d65ac-c827-4eeb-9bfa-8593a618cdec admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:31.844694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c294a1-48ec-4fed-8c83-ae3f6d6e7766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:31.845603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c294a1-48ec-4fed-8c83-ae3f6d6e7766 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:31.845734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c294a1-48ec-4fed-8c83-ae3f6d6e7766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:31.846160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c294a1-48ec-4fed-8c83-ae3f6d6e7766 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:31.851772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c294a1-48ec-4fed-8c83-ae3f6d6e7766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:31.854192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c294a1-48ec-4fed-8c83-ae3f6d6e7766 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:31.854612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:31.856042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:31.856042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:31.856042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] PATH_INFO: `/v3/projects/f3939939f7c3400b8ac15372accccd5c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:31.863402 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3939939f7c3400b8ac15372accccd5c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:31.867620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:31.913981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 843/1698] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:31 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:31.917910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c294a1-48ec-4fed-8c83-ae3f6d6e7766 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:31.999393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3939939f7c3400b8ac15372accccd5c', 'request_id': 'req-46bc97db-3c87-459e-88ff-da84c970d0e0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:32.021106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3939939f7c3400b8ac15372accccd5c', 'request_id': 'req-46bc97db-3c87-459e-88ff-da84c970d0e0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:32.027952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3939939f7c3400b8ac15372accccd5c', 'request_id': 'req-46bc97db-3c87-459e-88ff-da84c970d0e0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:32.053299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] The token cache is being invalidate because project f3939939f7c3400b8ac15372accccd5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:32.053793 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:32.058715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:32.060950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 856/1699] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:31 2022] DELETE /identity/v3/projects/f3939939f7c3400b8ac15372accccd5c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:32:32.067449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:32.070651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:32.141513 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c294a1-48ec-4fed-8c83-ae3f6d6e7766 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:32.212938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc97db-3c87-459e-88ff-da84c970d0e0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:32.230459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:32.231444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:32.231820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:32.232172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] PATH_INFO: `/v3/users/74d3f9373fa340edabf600cd96497019` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:32.233708 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d3f9373fa340edabf600cd96497019)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:32.236039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:32.340830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d3f9373fa340edabf600cd96497019'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:32.344027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d3f9373fa340edabf600cd96497019'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:32.372222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d3f9373fa340edabf600cd96497019'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:32.395819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d3f9373fa340edabf600cd96497019'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:32.418045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d3f9373fa340edabf600cd96497019'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:32.420958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:32.438328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 857/1700] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:32 2022] DELETE /identity/v3/users/74d3f9373fa340edabf600cd96497019 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:32.463998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c1e2e-60e7-4cf0-afef-934f1651c146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:32.467907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c1e2e-60e7-4cf0-afef-934f1651c146 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:32.468407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c1e2e-60e7-4cf0-afef-934f1651c146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:32.473293 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c1e2e-60e7-4cf0-afef-934f1651c146 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:32.474652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c1e2e-60e7-4cf0-afef-934f1651c146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:32.479569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c1e2e-60e7-4cf0-afef-934f1651c146 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:32.522428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 844/1701] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:31 2022] POST /identity/v3/users => generated 284 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:32.526224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:32.527741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:32.705807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b39d-c3e3-4509-a278-6078251db59f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:32.721119 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2004c-98be-477b-8817-c2f9894ff549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:32.722786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2004c-98be-477b-8817-c2f9894ff549 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:32.723319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2004c-98be-477b-8817-c2f9894ff549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:32.723795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2004c-98be-477b-8817-c2f9894ff549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:32.724746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2004c-98be-477b-8817-c2f9894ff549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:32.730405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2004c-98be-477b-8817-c2f9894ff549 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:32.746937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 858/1702] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:32.747775 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c1e2e-60e7-4cf0-afef-934f1651c146 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:32.762849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c1e2e-60e7-4cf0-afef-934f1651c146 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:32.769307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492a38b-068d-45e3-94b0-86565c48aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:32.770548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492a38b-068d-45e3-94b0-86565c48aca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:32.770548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492a38b-068d-45e3-94b0-86565c48aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:32.771050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492a38b-068d-45e3-94b0-86565c48aca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:32.773220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492a38b-068d-45e3-94b0-86565c48aca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:32.782286 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492a38b-068d-45e3-94b0-86565c48aca8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:32.804427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2004c-98be-477b-8817-c2f9894ff549 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:32.811207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 845/1703] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:32:32.819426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2004c-98be-477b-8817-c2f9894ff549 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:32.829263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338303ef-0a9e-407a-8456-492fb99ac5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:32.832946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338303ef-0a9e-407a-8456-492fb99ac5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:32.833524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338303ef-0a9e-407a-8456-492fb99ac5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:32.834036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338303ef-0a9e-407a-8456-492fb99ac5fe admin admin] PATH_INFO: `/v3/projects/38d62e1de53642e1b2304f4e26ac5644/users/ba799e7b893c4ef38097d73bbb31a868/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:32.876039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338303ef-0a9e-407a-8456-492fb99ac5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d62e1de53642e1b2304f4e26ac5644, user_id=ba799e7b893c4ef38097d73bbb31a868, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:32.879605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338303ef-0a9e-407a-8456-492fb99ac5fe admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:32.918731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683303e-8814-40fc-8d18-576d128ef4fb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:32.919153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683303e-8814-40fc-8d18-576d128ef4fb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:32.919539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683303e-8814-40fc-8d18-576d128ef4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:32.921101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 859/1704] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:32 2022] PUT /identity/v3/projects/38d62e1de53642e1b2304f4e26ac5644/users/ba799e7b893c4ef38097d73bbb31a868/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:32:33.000425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a683303e-8814-40fc-8d18-576d128ef4fb None None] MFA Rules not processed for user `ba799e7b893c4ef38097d73bbb31a868`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:33.003356 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a683303e-8814-40fc-8d18-576d128ef4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:33.085938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:33.227797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 846/1705] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:33.233676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338303ef-0a9e-407a-8456-492fb99ac5fe admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:33.412034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338303ef-0a9e-407a-8456-492fb99ac5fe admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:33.423932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57464b7e-17fa-4028-a467-489a7fd0c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:33.425024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57464b7e-17fa-4028-a467-489a7fd0c9da admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:33.427163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57464b7e-17fa-4028-a467-489a7fd0c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:33.428481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57464b7e-17fa-4028-a467-489a7fd0c9da admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:33.431680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57464b7e-17fa-4028-a467-489a7fd0c9da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:33.438669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57464b7e-17fa-4028-a467-489a7fd0c9da admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:33.517723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 860/1706] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:33 2022] POST /identity/v3/projects => generated 367 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:33.517910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683303e-8814-40fc-8d18-576d128ef4fb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:33.530467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683303e-8814-40fc-8d18-576d128ef4fb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:33.754067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da20567-bf42-4b82-a403-a1846a6a2cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:33.754792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da20567-bf42-4b82-a403-a1846a6a2cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:33.755077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da20567-bf42-4b82-a403-a1846a6a2cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:33.755355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da20567-bf42-4b82-a403-a1846a6a2cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:33.756068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da20567-bf42-4b82-a403-a1846a6a2cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:33.758012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da20567-bf42-4b82-a403-a1846a6a2cd6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:33.824102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 847/1707] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:33 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:33.826003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57464b7e-17fa-4028-a467-489a7fd0c9da admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:33.851778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57464b7e-17fa-4028-a467-489a7fd0c9da admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:33.861377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a772e1-e04e-4afc-ab99-4ea60ee2d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:33.863315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a772e1-e04e-4afc-ab99-4ea60ee2d728 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:33.863315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a772e1-e04e-4afc-ab99-4ea60ee2d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:33.863494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a772e1-e04e-4afc-ab99-4ea60ee2d728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:33.864325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a772e1-e04e-4afc-ab99-4ea60ee2d728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:33.870886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a772e1-e04e-4afc-ab99-4ea60ee2d728 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:33.919417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 861/1708] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:33.923817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da20567-bf42-4b82-a403-a1846a6a2cd6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:33.939879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da20567-bf42-4b82-a403-a1846a6a2cd6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:33.951255 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3396f1-5758-4e0e-afee-c1580602c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:33.952499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3396f1-5758-4e0e-afee-c1580602c5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:33.952781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3396f1-5758-4e0e-afee-c1580602c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:33.953058 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3396f1-5758-4e0e-afee-c1580602c5c1 admin admin] PATH_INFO: `/v3/projects/279adadca37b49cca7f7f8a9ffc8aec7/users/469019fafd794b54ad25e7b2139ac1e6/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:33.980327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3396f1-5758-4e0e-afee-c1580602c5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279adadca37b49cca7f7f8a9ffc8aec7, user_id=469019fafd794b54ad25e7b2139ac1e6, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:33.984524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3396f1-5758-4e0e-afee-c1580602c5c1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:34.021579 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 848/1709] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:33 2022] PUT /identity/v3/projects/279adadca37b49cca7f7f8a9ffc8aec7/users/469019fafd794b54ad25e7b2139ac1e6/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:34.028111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a772e1-e04e-4afc-ab99-4ea60ee2d728 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:34.043747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3396f1-5758-4e0e-afee-c1580602c5c1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:34.053826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bf3396f1-5758-4e0e-afee-c1580602c5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:34.061820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a772e1-e04e-4afc-ab99-4ea60ee2d728 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:34.259577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:34.281078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25049-7a48-496a-8325-5ac5ec235365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:34.282043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25049-7a48-496a-8325-5ac5ec235365 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:34.282518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25049-7a48-496a-8325-5ac5ec235365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:34.282934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25049-7a48-496a-8325-5ac5ec235365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:34.283816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a25049-7a48-496a-8325-5ac5ec235365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:34.286587 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a25049-7a48-496a-8325-5ac5ec235365 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:34.303717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 862/1710] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:34.304897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25049-7a48-496a-8325-5ac5ec235365 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:34.315798 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25049-7a48-496a-8325-5ac5ec235365 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:34.321980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7e487-bdd7-492b-bd97-23b1606c5eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:34.323155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e487-bdd7-492b-bd97-23b1606c5eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:34.323580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e487-bdd7-492b-bd97-23b1606c5eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:34.323995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e487-bdd7-492b-bd97-23b1606c5eb1 admin admin] PATH_INFO: `/v3/projects/279adadca37b49cca7f7f8a9ffc8aec7/users/469019fafd794b54ad25e7b2139ac1e6/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:34.326676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7e487-bdd7-492b-bd97-23b1606c5eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279adadca37b49cca7f7f8a9ffc8aec7, user_id=469019fafd794b54ad25e7b2139ac1e6, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:34.330278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7e487-bdd7-492b-bd97-23b1606c5eb1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:34.349327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 863/1711] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:34 2022] PUT /identity/v3/projects/279adadca37b49cca7f7f8a9ffc8aec7/users/469019fafd794b54ad25e7b2139ac1e6/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:34.360656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19eff1-0e5c-4f97-81de-3c700bcd66eb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:34.361122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19eff1-0e5c-4f97-81de-3c700bcd66eb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:34.361562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19eff1-0e5c-4f97-81de-3c700bcd66eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:34.377749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3396f1-5758-4e0e-afee-c1580602c5c1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:34.415172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1b19eff1-0e5c-4f97-81de-3c700bcd66eb None None] MFA Rules not processed for user `469019fafd794b54ad25e7b2139ac1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:34.416768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1b19eff1-0e5c-4f97-81de-3c700bcd66eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:34.496865 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:34.561472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:34.561937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:34.561937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:34.562229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] PATH_INFO: `/v3/projects/424f44e462314b2e8c2af5616c0ae4c9` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:34.563958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=424f44e462314b2e8c2af5616c0ae4c9)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:34.566698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:34.638113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 864/1712] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:34.647677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19eff1-0e5c-4f97-81de-3c700bcd66eb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:34.649080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1b19eff1-0e5c-4f97-81de-3c700bcd66eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:34.676499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '424f44e462314b2e8c2af5616c0ae4c9', 'request_id': 'req-7489f66e-e632-4a91-9013-6378b6e2d0af'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:34.689334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '424f44e462314b2e8c2af5616c0ae4c9', 'request_id': 'req-7489f66e-e632-4a91-9013-6378b6e2d0af'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:34.705333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '424f44e462314b2e8c2af5616c0ae4c9', 'request_id': 'req-7489f66e-e632-4a91-9013-6378b6e2d0af'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:34.735803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] The token cache is being invalidate because project 424f44e462314b2e8c2af5616c0ae4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:34.736103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:34.736925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7489f66e-e632-4a91-9013-6378b6e2d0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:34.739002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 849/1713] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:34 2022] DELETE /identity/v3/projects/424f44e462314b2e8c2af5616c0ae4c9 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:34.743863 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9a642-2a06-4a84-a0ec-ec1d7e15b517 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:34.744162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9a642-2a06-4a84-a0ec-ec1d7e15b517 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:34.744450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9a642-2a06-4a84-a0ec-ec1d7e15b517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:34.787813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b4f9a642-2a06-4a84-a0ec-ec1d7e15b517 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:34.789055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b4f9a642-2a06-4a84-a0ec-ec1d7e15b517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:34.798242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19eff1-0e5c-4f97-81de-3c700bcd66eb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:34.931565 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213b1d0-7642-4dba-96e0-91c38f9189ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:34.932021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213b1d0-7642-4dba-96e0-91c38f9189ea service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:34.932417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213b1d0-7642-4dba-96e0-91c38f9189ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:34.932887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213b1d0-7642-4dba-96e0-91c38f9189ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:34.936821 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4213b1d0-7642-4dba-96e0-91c38f9189ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:34.964274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 850/1714] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:34.972459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9443a9-1e51-47b6-99e4-50e9ab48d422 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:34.972684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9443a9-1e51-47b6-99e4-50e9ab48d422 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:34.972950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9443a9-1e51-47b6-99e4-50e9ab48d422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:35.023836 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:35.066104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8a9443a9-1e51-47b6-99e4-50e9ab48d422 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:35.066104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8a9443a9-1e51-47b6-99e4-50e9ab48d422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:35.101155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 851/1715] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:35.106382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9443a9-1e51-47b6-99e4-50e9ab48d422 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:35.136383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9443a9-1e51-47b6-99e4-50e9ab48d422 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:35.155842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624db1e8-6708-4647-b96f-5913adf4234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:35.157657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624db1e8-6708-4647-b96f-5913adf4234b admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:35.157953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624db1e8-6708-4647-b96f-5913adf4234b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:35.159416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624db1e8-6708-4647-b96f-5913adf4234b admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:35.160230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624db1e8-6708-4647-b96f-5913adf4234b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:35.160537 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624db1e8-6708-4647-b96f-5913adf4234b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:35.165161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624db1e8-6708-4647-b96f-5913adf4234b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:35.212863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213b1d0-7642-4dba-96e0-91c38f9189ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:35.217454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 852/1716] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:35.217844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213b1d0-7642-4dba-96e0-91c38f9189ea service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:35.220041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624db1e8-6708-4647-b96f-5913adf4234b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:35.262326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624db1e8-6708-4647-b96f-5913adf4234b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:35.265309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 865/1717] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:32:35.289310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a737b93-ccd0-4e85-beae-34e12c4a56c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:35.290000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a737b93-ccd0-4e85-beae-34e12c4a56c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:35.290290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a737b93-ccd0-4e85-beae-34e12c4a56c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:35.294445 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a737b93-ccd0-4e85-beae-34e12c4a56c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:35.295257 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a737b93-ccd0-4e85-beae-34e12c4a56c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:35.297193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a737b93-ccd0-4e85-beae-34e12c4a56c9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:35.388737 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 853/1718] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:35 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:35.392805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213b1d0-7642-4dba-96e0-91c38f9189ea service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:35.422957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213b1d0-7642-4dba-96e0-91c38f9189ea service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:35.698112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5e941-8526-458f-bcb5-f7258e0627c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:35.700498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5e941-8526-458f-bcb5-f7258e0627c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:35.701048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5e941-8526-458f-bcb5-f7258e0627c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:35.702716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5e941-8526-458f-bcb5-f7258e0627c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:35.703670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5e941-8526-458f-bcb5-f7258e0627c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:35.708398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5e941-8526-458f-bcb5-f7258e0627c0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:35.772637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 866/1719] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:35 2022] POST /identity/v3/users => generated 291 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:35.776804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a737b93-ccd0-4e85-beae-34e12c4a56c9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:35.790148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a737b93-ccd0-4e85-beae-34e12c4a56c9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:35.809676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234c476-eb02-4bcd-846b-4fda71808425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:35.810874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234c476-eb02-4bcd-846b-4fda71808425 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:35.811313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234c476-eb02-4bcd-846b-4fda71808425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:35.811852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234c476-eb02-4bcd-846b-4fda71808425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:35.812819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234c476-eb02-4bcd-846b-4fda71808425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:35.817787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234c476-eb02-4bcd-846b-4fda71808425 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:35.845546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5e941-8526-458f-bcb5-f7258e0627c0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:35.846939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 854/1720] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:35.857289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5e941-8526-458f-bcb5-f7258e0627c0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:35.876491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27ac62-b09e-4529-b60e-ccdc36e2e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:35.877195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27ac62-b09e-4529-b60e-ccdc36e2e2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:35.877488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27ac62-b09e-4529-b60e-ccdc36e2e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:35.877771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27ac62-b09e-4529-b60e-ccdc36e2e2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:35.879125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27ac62-b09e-4529-b60e-ccdc36e2e2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:35.880766 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27ac62-b09e-4529-b60e-ccdc36e2e2ea admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:35.915072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 867/1721] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:35.919296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234c476-eb02-4bcd-846b-4fda71808425 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:35.939146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234c476-eb02-4bcd-846b-4fda71808425 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:35.948594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af364b77-b0bd-4a9c-a217-8d95871dda33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:35.950297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af364b77-b0bd-4a9c-a217-8d95871dda33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:35.950807 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af364b77-b0bd-4a9c-a217-8d95871dda33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:35.951227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af364b77-b0bd-4a9c-a217-8d95871dda33 admin admin] PATH_INFO: `/v3/projects/bba60f8bae524c35b70ddd480f734834/users/df8a0ed1a9f54542b8c3dee94ccdbfe7/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:35.968131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408f76-7039-45a9-a7cf-81bda43344d2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:35.968600 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408f76-7039-45a9-a7cf-81bda43344d2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:35.968897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b408f76-7039-45a9-a7cf-81bda43344d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:36.009119 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:36.023531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5b408f76-7039-45a9-a7cf-81bda43344d2 None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:36.024795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5b408f76-7039-45a9-a7cf-81bda43344d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:36.029145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af364b77-b0bd-4a9c-a217-8d95871dda33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba60f8bae524c35b70ddd480f734834, user_id=df8a0ed1a9f54542b8c3dee94ccdbfe7, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:36.031909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af364b77-b0bd-4a9c-a217-8d95871dda33 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:36.096101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 855/1722] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:35 2022] PUT /identity/v3/projects/bba60f8bae524c35b70ddd480f734834/users/df8a0ed1a9f54542b8c3dee94ccdbfe7/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:36.107050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f88b1-1897-44f0-87b5-e878b0b73d5f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:36.107348 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f88b1-1897-44f0-87b5-e878b0b73d5f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:36.107636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f88b1-1897-44f0-87b5-e878b0b73d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:36.242007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3e2f88b1-1897-44f0-87b5-e878b0b73d5f None None] MFA Rules not processed for user `df8a0ed1a9f54542b8c3dee94ccdbfe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:36.255878 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3e2f88b1-1897-44f0-87b5-e878b0b73d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:36.320459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 868/1723] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:32:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:36.517427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 856/1724] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:36.523042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b408f76-7039-45a9-a7cf-81bda43344d2 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:36.547528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b408f76-7039-45a9-a7cf-81bda43344d2 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:36.707042 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f88b1-1897-44f0-87b5-e878b0b73d5f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:36.708661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3e2f88b1-1897-44f0-87b5-e878b0b73d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:36.713120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:36.783503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f126f4-9037-4015-93c1-f032b8c1b2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:36.784549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f126f4-9037-4015-93c1-f032b8c1b2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:36.784977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f126f4-9037-4015-93c1-f032b8c1b2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:36.785390 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f126f4-9037-4015-93c1-f032b8c1b2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:36.786552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f126f4-9037-4015-93c1-f032b8c1b2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:36.788626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f126f4-9037-4015-93c1-f032b8c1b2a6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:36.896037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 869/1725] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:36 2022] POST /identity/v3/projects => generated 375 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:36.898551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f126f4-9037-4015-93c1-f032b8c1b2a6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:36.927498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f88b1-1897-44f0-87b5-e878b0b73d5f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:37.066393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49decec8-f123-48d8-b55f-3565946e8ac1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:37.067236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49decec8-f123-48d8-b55f-3565946e8ac1 service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:37.067530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49decec8-f123-48d8-b55f-3565946e8ac1 service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:37.067814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49decec8-f123-48d8-b55f-3565946e8ac1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:37.126023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f126f4-9037-4015-93c1-f032b8c1b2a6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:37.139678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfa623-640f-4e87-889c-165739db6c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:37.140380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfa623-640f-4e87-889c-165739db6c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:37.140674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfa623-640f-4e87-889c-165739db6c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:37.140958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfa623-640f-4e87-889c-165739db6c4a admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:37.141667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfa623-640f-4e87-889c-165739db6c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:37.147576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfa623-640f-4e87-889c-165739db6c4a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:37.150037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:37.217236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 870/1726] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:36 2022] POST /identity/v3/users => generated 294 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:37.219282 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfa623-640f-4e87-889c-165739db6c4a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:37.255182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49decec8-f123-48d8-b55f-3565946e8ac1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:37.255471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfa623-640f-4e87-889c-165739db6c4a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:37.256834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49decec8-f123-48d8-b55f-3565946e8ac1 service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:37.273432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 857/1727] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:32:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 10:32:37.284460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8096c-fa4f-4132-a4f8-338346da10ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:37.287480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8096c-fa4f-4132-a4f8-338346da10ee admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:37.287851 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8096c-fa4f-4132-a4f8-338346da10ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:37.288215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8096c-fa4f-4132-a4f8-338346da10ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:37.289971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8096c-fa4f-4132-a4f8-338346da10ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:37.294181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8096c-fa4f-4132-a4f8-338346da10ee admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:37.343936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 871/1728] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:37.349872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49decec8-f123-48d8-b55f-3565946e8ac1 service swift] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:37.380145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49decec8-f123-48d8-b55f-3565946e8ac1 service swift] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:37.395173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e81654-96a6-4780-a514-328677079df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:37.401136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e81654-96a6-4780-a514-328677079df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:37.403274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e81654-96a6-4780-a514-328677079df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:37.405221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e81654-96a6-4780-a514-328677079df5 admin admin] PATH_INFO: `/v3/projects/954b19e03fda43da938cb8426c7edc4f/users/24cd8dce3f5d449ba17d19f57b145656/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:37.477862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e81654-96a6-4780-a514-328677079df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954b19e03fda43da938cb8426c7edc4f, user_id=24cd8dce3f5d449ba17d19f57b145656, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:37.484497 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e81654-96a6-4780-a514-328677079df5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:37.494498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce620e6f-603f-464a-be78-3a91f748abcc None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:37.494907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce620e6f-603f-464a-be78-3a91f748abcc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:37.495350 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce620e6f-603f-464a-be78-3a91f748abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:37.547234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 858/1729] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:37 2022] PUT /identity/v3/projects/954b19e03fda43da938cb8426c7edc4f/users/24cd8dce3f5d449ba17d19f57b145656/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:37.551972 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e81654-96a6-4780-a514-328677079df5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:37.615331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ce620e6f-603f-464a-be78-3a91f748abcc None None] MFA Rules not processed for user `6ca2454700fa46dbbfe0fe44bcbc266c`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:37.619471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ce620e6f-603f-464a-be78-3a91f748abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:37.837759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e81654-96a6-4780-a514-328677079df5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:37.858174 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973920a-df1f-43c8-ae7b-d5ac13f53b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:37.859003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973920a-df1f-43c8-ae7b-d5ac13f53b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:37.859481 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973920a-df1f-43c8-ae7b-d5ac13f53b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:37.860398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973920a-df1f-43c8-ae7b-d5ac13f53b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:37.862301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973920a-df1f-43c8-ae7b-d5ac13f53b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:37.867154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973920a-df1f-43c8-ae7b-d5ac13f53b71 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:37.890385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 872/1730] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:37.898497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce620e6f-603f-464a-be78-3a91f748abcc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:37.902269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ce620e6f-603f-464a-be78-3a91f748abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:37.908696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 859/1731] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:37.910420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973920a-df1f-43c8-ae7b-d5ac13f53b71 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:37.947923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973920a-df1f-43c8-ae7b-d5ac13f53b71 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:37.976022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07e03b-064f-4936-94b8-41cf6290ceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:37.977128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07e03b-064f-4936-94b8-41cf6290ceb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:37.977419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07e03b-064f-4936-94b8-41cf6290ceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:37.977696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07e03b-064f-4936-94b8-41cf6290ceb5 admin admin] PATH_INFO: `/v3/projects/954b19e03fda43da938cb8426c7edc4f/users/24cd8dce3f5d449ba17d19f57b145656/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:37.984469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07e03b-064f-4936-94b8-41cf6290ceb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954b19e03fda43da938cb8426c7edc4f, user_id=24cd8dce3f5d449ba17d19f57b145656, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:38.001172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07e03b-064f-4936-94b8-41cf6290ceb5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:38.017076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:38.070126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 860/1732] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:37 2022] PUT /identity/v3/projects/954b19e03fda43da938cb8426c7edc4f/users/24cd8dce3f5d449ba17d19f57b145656/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:38.072065 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68c02-863a-483c-8e20-9ceaad1545db None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:38.094272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68c02-863a-483c-8e20-9ceaad1545db None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:38.094272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68c02-863a-483c-8e20-9ceaad1545db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:38.126859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce620e6f-603f-464a-be78-3a91f748abcc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:38.183172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-56f68c02-863a-483c-8e20-9ceaad1545db None None] MFA Rules not processed for user `24cd8dce3f5d449ba17d19f57b145656`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:38.188786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-56f68c02-863a-483c-8e20-9ceaad1545db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:38.339268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046511ef-bbb5-46ae-9613-dbfc799611b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:38.340027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046511ef-bbb5-46ae-9613-dbfc799611b9 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:38.340232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046511ef-bbb5-46ae-9613-dbfc799611b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:38.340520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046511ef-bbb5-46ae-9613-dbfc799611b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:38.441583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046511ef-bbb5-46ae-9613-dbfc799611b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:38.443718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046511ef-bbb5-46ae-9613-dbfc799611b9 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:38.460358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 873/1733] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:38.486415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 861/1734] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:38.501069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046511ef-bbb5-46ae-9613-dbfc799611b9 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:38.504430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-046511ef-bbb5-46ae-9613-dbfc799611b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:38.702726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046511ef-bbb5-46ae-9613-dbfc799611b9 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:38.713463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddf806-3ce6-4b6c-b58e-be504d82d44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:38.714833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf806-3ce6-4b6c-b58e-be504d82d44d service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:38.714833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf806-3ce6-4b6c-b58e-be504d82d44d service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:38.714833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf806-3ce6-4b6c-b58e-be504d82d44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:38.739617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddf806-3ce6-4b6c-b58e-be504d82d44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:38.742840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddf806-3ce6-4b6c-b58e-be504d82d44d service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:38.769782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 874/1735] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:39.148773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f68c02-863a-483c-8e20-9ceaad1545db None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:39.150299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-56f68c02-863a-483c-8e20-9ceaad1545db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:39.200289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f68c02-863a-483c-8e20-9ceaad1545db None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:39.219801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135438a3-e22c-4e56-8f93-e8b564037eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:39.223304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135438a3-e22c-4e56-8f93-e8b564037eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:39.224824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135438a3-e22c-4e56-8f93-e8b564037eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:39.225099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135438a3-e22c-4e56-8f93-e8b564037eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:39.249756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:39.463662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135438a3-e22c-4e56-8f93-e8b564037eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:39.465051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135438a3-e22c-4e56-8f93-e8b564037eb0 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:39.492053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 862/1736] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:39.869901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddf806-3ce6-4b6c-b58e-be504d82d44d service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:39.871427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-40ddf806-3ce6-4b6c-b58e-be504d82d44d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:39.912807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:40.111807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddf806-3ce6-4b6c-b58e-be504d82d44d service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:40.140256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:40.141242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:40.141500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:40.145326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] PATH_INFO: `/v3/users/ba799e7b893c4ef38097d73bbb31a868` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:40.148205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba799e7b893c4ef38097d73bbb31a868)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:40.154260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:40.308002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba799e7b893c4ef38097d73bbb31a868'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:40.309588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba799e7b893c4ef38097d73bbb31a868'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:40.332480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba799e7b893c4ef38097d73bbb31a868'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:40.353392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba799e7b893c4ef38097d73bbb31a868'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:40.399964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba799e7b893c4ef38097d73bbb31a868'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:40.415601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 875/1737] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:39 2022] DELETE /identity/v3/users/ba799e7b893c4ef38097d73bbb31a868 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:40.416703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320b6cd-4eb5-40eb-9abe-1d7921b655c1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:40.417187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320b6cd-4eb5-40eb-9abe-1d7921b655c1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:40.417281 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320b6cd-4eb5-40eb-9abe-1d7921b655c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:40.459554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7320b6cd-4eb5-40eb-9abe-1d7921b655c1 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:40.463012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7320b6cd-4eb5-40eb-9abe-1d7921b655c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:40.612826 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:40.614661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:40.683918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 863/1738] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:40.685674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c1e3-15af-4d9f-949a-f996bbfe5e14 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:40.685981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c1e3-15af-4d9f-949a-f996bbfe5e14 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:40.686265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c1e3-15af-4d9f-949a-f996bbfe5e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:40.763266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-aa25c1e3-15af-4d9f-949a-f996bbfe5e14 None None] MFA Rules not processed for user `4a4e638dc0dd459699b76df35568e795`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:40.764534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-aa25c1e3-15af-4d9f-949a-f996bbfe5e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:40.863814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1144a55-aa1b-410b-9349-8620d5ccbc58 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:40.884027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:40.890008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:40.890402 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:40.890583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] PATH_INFO: `/v3/users/5fcd6b147a8146c4bd7674c9284d3ee0` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:40.892151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fcd6b147a8146c4bd7674c9284d3ee0)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:40.895054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:40.957963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 864/1739] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:40.959140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25c1e3-15af-4d9f-949a-f996bbfe5e14 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:40.961505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-aa25c1e3-15af-4d9f-949a-f996bbfe5e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:41.036584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:41.096652 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fcd6b147a8146c4bd7674c9284d3ee0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:41.104982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fcd6b147a8146c4bd7674c9284d3ee0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:41.136468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fcd6b147a8146c4bd7674c9284d3ee0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:41.237707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fcd6b147a8146c4bd7674c9284d3ee0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:41.266842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:41.305011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fcd6b147a8146c4bd7674c9284d3ee0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:41.335789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 876/1740] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:40 2022] DELETE /identity/v3/users/5fcd6b147a8146c4bd7674c9284d3ee0 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:41.336717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:41.342787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:41.384335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25c1e3-15af-4d9f-949a-f996bbfe5e14 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:41.623371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e747d-3aae-41c7-8cf5-5e90762a1d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:41.625487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e747d-3aae-41c7-8cf5-5e90762a1d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:41.627434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e747d-3aae-41c7-8cf5-5e90762a1d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:41.627434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e747d-3aae-41c7-8cf5-5e90762a1d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:41.632023 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-314e747d-3aae-41c7-8cf5-5e90762a1d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:41.694198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbbf60-2854-4e2b-8e4f-0b102844971a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:41.711077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7873c2-cae9-425b-84f4-71f25078304a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:41.711964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7873c2-cae9-425b-84f4-71f25078304a service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:41.712255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7873c2-cae9-425b-84f4-71f25078304a service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:41.712535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7873c2-cae9-425b-84f4-71f25078304a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:41.721990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ab7873c2-cae9-425b-84f4-71f25078304a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:41.910882 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e747d-3aae-41c7-8cf5-5e90762a1d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:41.918614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e747d-3aae-41c7-8cf5-5e90762a1d20 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:41.948961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 865/1741] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 990 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:41.954678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2184c3-dd0e-40f8-a0df-53bf4e982406 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:41.955207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2184c3-dd0e-40f8-a0df-53bf4e982406 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:41.955700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2184c3-dd0e-40f8-a0df-53bf4e982406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:41.967604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7873c2-cae9-425b-84f4-71f25078304a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:41.973371 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7873c2-cae9-425b-84f4-71f25078304a service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:42.001373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ef2184c3-dd0e-40f8-a0df-53bf4e982406 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:42.005634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 877/1742] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:42.006546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ef2184c3-dd0e-40f8-a0df-53bf4e982406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:42.021219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 866/1743] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:42.097190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7873c2-cae9-425b-84f4-71f25078304a service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:42.101106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ab7873c2-cae9-425b-84f4-71f25078304a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:42.133112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7873c2-cae9-425b-84f4-71f25078304a service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:42.152604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb6045-0f51-4db7-bdd9-61d0eda5d2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:42.153451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb6045-0f51-4db7-bdd9-61d0eda5d2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:42.153869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb6045-0f51-4db7-bdd9-61d0eda5d2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:42.154407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb6045-0f51-4db7-bdd9-61d0eda5d2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:42.193769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb6045-0f51-4db7-bdd9-61d0eda5d2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:42.202040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb6045-0f51-4db7-bdd9-61d0eda5d2c6 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:42.234745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 878/1744] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:42.859672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274014-9998-4bce-b65a-5957859c2ee0 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:42.860547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274014-9998-4bce-b65a-5957859c2ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:42.860547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274014-9998-4bce-b65a-5957859c2ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:42.938490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ef274014-9998-4bce-b65a-5957859c2ee0 None None] MFA Rules not processed for user `6e971595d77647dca5a29a5574c6627d`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:42.941057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ef274014-9998-4bce-b65a-5957859c2ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:43.171493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 867/1745] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:43.183468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f67477-8fc3-4ffc-b090-511f65b02653 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:43.184627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f67477-8fc3-4ffc-b090-511f65b02653 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:43.185060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f67477-8fc3-4ffc-b090-511f65b02653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:43.217300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b8f67477-8fc3-4ffc-b090-511f65b02653 None None] MFA Rules not processed for user `6e971595d77647dca5a29a5574c6627d`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:43.219308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b8f67477-8fc3-4ffc-b090-511f65b02653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:43.244799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 879/1746] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:43.256438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef274014-9998-4bce-b65a-5957859c2ee0 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:43.283110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef274014-9998-4bce-b65a-5957859c2ee0 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:43.295949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c024215-21f2-4992-bb5c-83ccd25cf17f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:43.296864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c024215-21f2-4992-bb5c-83ccd25cf17f service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:43.297304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c024215-21f2-4992-bb5c-83ccd25cf17f service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:43.297746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c024215-21f2-4992-bb5c-83ccd25cf17f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:43.340646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c024215-21f2-4992-bb5c-83ccd25cf17f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:43.343975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c024215-21f2-4992-bb5c-83ccd25cf17f service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:43.366885 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 868/1747] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:44.208656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04b50-37d3-4949-b2c4-840e5e59cfc6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:44.209138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04b50-37d3-4949-b2c4-840e5e59cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:44.209326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04b50-37d3-4949-b2c4-840e5e59cfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:44.265777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1ed04b50-37d3-4949-b2c4-840e5e59cfc6 None None] MFA Rules not processed for user `4160318c1b9b49539c6a2d8110289463`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:44.270959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1ed04b50-37d3-4949-b2c4-840e5e59cfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:44.293168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 880/1748] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Jun 24 10:32:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:44.456749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c024215-21f2-4992-bb5c-83ccd25cf17f service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:44.458728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8c024215-21f2-4992-bb5c-83ccd25cf17f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:44.504198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c024215-21f2-4992-bb5c-83ccd25cf17f service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:44.522168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d1f45-19ce-4a69-97ab-19fb5360ca4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:44.523205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d1f45-19ce-4a69-97ab-19fb5360ca4f service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:44.530802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d1f45-19ce-4a69-97ab-19fb5360ca4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:44.531600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d1f45-19ce-4a69-97ab-19fb5360ca4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:44.579900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420edcc-21cf-49cb-bccb-f104fd683abe None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:44.580678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420edcc-21cf-49cb-bccb-f104fd683abe None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:44.581670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420edcc-21cf-49cb-bccb-f104fd683abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:44.588147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d1f45-19ce-4a69-97ab-19fb5360ca4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:44.596087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d1f45-19ce-4a69-97ab-19fb5360ca4f service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:44.610570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:44.635467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 869/1749] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:44.663043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d420edcc-21cf-49cb-bccb-f104fd683abe None None] MFA Rules not processed for user `1b925b5e87dc489db1dd5e994e47e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:44.677587 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d420edcc-21cf-49cb-bccb-f104fd683abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:44.727924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:45.031438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 881/1750] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:45.803651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39a5d-aa65-473b-a274-90dda456622e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:45.804405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39a5d-aa65-473b-a274-90dda456622e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:45.804695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39a5d-aa65-473b-a274-90dda456622e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:45.807984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 870/1751] 10.222.0.44 () {54 vars in 912 bytes} [Fri Jun 24 10:32:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:32:45.813575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5da0b-25b6-4a1e-afe2-e10229565731 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:45.814583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5da0b-25b6-4a1e-afe2-e10229565731 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:45.815080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5da0b-25b6-4a1e-afe2-e10229565731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:45.868301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-72e5da0b-25b6-4a1e-afe2-e10229565731 None None] MFA Rules not processed for user `4160318c1b9b49539c6a2d8110289463`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:45.870068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-72e5da0b-25b6-4a1e-afe2-e10229565731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:45.892284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 882/1752] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:45.980037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff39a5d-aa65-473b-a274-90dda456622e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:46.033267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff39a5d-aa65-473b-a274-90dda456622e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:46.052156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b71ba-3856-4004-87a0-8ae8044ac5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:46.052999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b71ba-3856-4004-87a0-8ae8044ac5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:46.053435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b71ba-3856-4004-87a0-8ae8044ac5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:46.054813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b71ba-3856-4004-87a0-8ae8044ac5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:46.067652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b71ba-3856-4004-87a0-8ae8044ac5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:46.082152 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5da0b-25b6-4a1e-afe2-e10229565731 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:46.084294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-72e5da0b-25b6-4a1e-afe2-e10229565731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:46.110387 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b71ba-3856-4004-87a0-8ae8044ac5f4 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:46.116843 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5da0b-25b6-4a1e-afe2-e10229565731 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:46.129541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:46.130532 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:46.131146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:46.131568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] PATH_INFO: `/v3/projects/2b30d0a6fca149e792bf5f3f9ff60479` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:46.132552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 871/1753] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:46.137991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b30d0a6fca149e792bf5f3f9ff60479)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:46.152294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:46.158688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b71ba-3856-4004-87a0-8ae8044ac5f4 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:46.160837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-140b71ba-3856-4004-87a0-8ae8044ac5f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:46.204157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b71ba-3856-4004-87a0-8ae8044ac5f4 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:46.251401 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6a7b3-fa75-46f4-b8ad-2f55818699d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:46.257589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6a7b3-fa75-46f4-b8ad-2f55818699d7 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:46.259662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6a7b3-fa75-46f4-b8ad-2f55818699d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:46.260360 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6a7b3-fa75-46f4-b8ad-2f55818699d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:46.289997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6a7b3-fa75-46f4-b8ad-2f55818699d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:46.291816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6a7b3-fa75-46f4-b8ad-2f55818699d7 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:46.297423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b30d0a6fca149e792bf5f3f9ff60479', 'request_id': 'req-384105eb-95d0-463a-8f9e-0d761e3681c2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:46.312751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 872/1754] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:46.313195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b30d0a6fca149e792bf5f3f9ff60479', 'request_id': 'req-384105eb-95d0-463a-8f9e-0d761e3681c2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:46.329636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b30d0a6fca149e792bf5f3f9ff60479', 'request_id': 'req-384105eb-95d0-463a-8f9e-0d761e3681c2'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:46.361710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] The token cache is being invalidate because project 2b30d0a6fca149e792bf5f3f9ff60479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:46.362010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:46.364823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-384105eb-95d0-463a-8f9e-0d761e3681c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:46.374175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 883/1755] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:46 2022] DELETE /identity/v3/projects/2b30d0a6fca149e792bf5f3f9ff60479 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:46.380188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0915d6-376f-49f4-9bb1-1bf6447970fa None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:46.380540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0915d6-376f-49f4-9bb1-1bf6447970fa None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:46.380876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0915d6-376f-49f4-9bb1-1bf6447970fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:46.426340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4e0915d6-376f-49f4-9bb1-1bf6447970fa None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:46.427601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4e0915d6-376f-49f4-9bb1-1bf6447970fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:46.600776 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 873/1756] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:46.609303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a3f1-406a-4c0c-bf30-6755a44aea7e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:46.609696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a3f1-406a-4c0c-bf30-6755a44aea7e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:46.609925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a3f1-406a-4c0c-bf30-6755a44aea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:46.648570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a4a5a3f1-406a-4c0c-bf30-6755a44aea7e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:46.649991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a4a5a3f1-406a-4c0c-bf30-6755a44aea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:46.674729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 884/1757] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:46.676200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0915d6-376f-49f4-9bb1-1bf6447970fa None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:46.696502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0915d6-376f-49f4-9bb1-1bf6447970fa None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:46.706114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b9d16-1719-46eb-9320-43feac848264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:46.707348 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b9d16-1719-46eb-9320-43feac848264 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:46.707631 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b9d16-1719-46eb-9320-43feac848264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:46.707906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b9d16-1719-46eb-9320-43feac848264 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:46.708641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b9d16-1719-46eb-9320-43feac848264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:46.708944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b9d16-1719-46eb-9320-43feac848264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:46.710577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b9d16-1719-46eb-9320-43feac848264 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:46.770035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a3f1-406a-4c0c-bf30-6755a44aea7e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:46.785064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 874/1758] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:46.785723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a3f1-406a-4c0c-bf30-6755a44aea7e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:46.808866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fd3d1-9671-41f8-aba2-164e1a37a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:46.809678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fd3d1-9671-41f8-aba2-164e1a37a0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:46.809968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fd3d1-9671-41f8-aba2-164e1a37a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:46.810248 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fd3d1-9671-41f8-aba2-164e1a37a0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:46.811332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fd3d1-9671-41f8-aba2-164e1a37a0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:46.821275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fd3d1-9671-41f8-aba2-164e1a37a0fe admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:46.894445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 885/1759] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:46 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:46.899229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b9d16-1719-46eb-9320-43feac848264 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:46.912063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b9d16-1719-46eb-9320-43feac848264 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:46.958841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fd3d1-9671-41f8-aba2-164e1a37a0fe admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:46.963275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d62fd3d1-9671-41f8-aba2-164e1a37a0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:47.151252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fd3d1-9671-41f8-aba2-164e1a37a0fe admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:47.157425 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:47.158816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:47.159916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:47.161037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] PATH_INFO: `/v3/projects/38d62e1de53642e1b2304f4e26ac5644` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:47.168147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d62e1de53642e1b2304f4e26ac5644)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:47.170540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:47.173906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:47.177930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e48791-7693-4be1-b911-14daa6e608d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:47.178654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48791-7693-4be1-b911-14daa6e608d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:47.178939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48791-7693-4be1-b911-14daa6e608d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:47.179218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48791-7693-4be1-b911-14daa6e608d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:47.179919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e48791-7693-4be1-b911-14daa6e608d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:47.184569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e48791-7693-4be1-b911-14daa6e608d9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:47.276056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d62e1de53642e1b2304f4e26ac5644', 'request_id': 'req-509e6d41-9010-4935-98e6-ec281a3fe66c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:47.287401 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 875/1760] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:46 2022] POST /identity/v3/users => generated 292 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:47.290812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e48791-7693-4be1-b911-14daa6e608d9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:47.291446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d62e1de53642e1b2304f4e26ac5644', 'request_id': 'req-509e6d41-9010-4935-98e6-ec281a3fe66c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:47.304103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e48791-7693-4be1-b911-14daa6e608d9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:47.310070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d62e1de53642e1b2304f4e26ac5644', 'request_id': 'req-509e6d41-9010-4935-98e6-ec281a3fe66c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:47.345083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] The token cache is being invalidate because project 38d62e1de53642e1b2304f4e26ac5644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:47.348179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:47.349419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:47.355621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 886/1761] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:46 2022] DELETE /identity/v3/projects/38d62e1de53642e1b2304f4e26ac5644 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:47.361386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:47.364728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:47.488312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:47.585339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e6d41-9010-4935-98e6-ec281a3fe66c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:47.589372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa513be-636a-45d4-a08c-db75ec7a7c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:47.590164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa513be-636a-45d4-a08c-db75ec7a7c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:47.590483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa513be-636a-45d4-a08c-db75ec7a7c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:47.590726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa513be-636a-45d4-a08c-db75ec7a7c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:47.591433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:47.591572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa513be-636a-45d4-a08c-db75ec7a7c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:47.592375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:47.592756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:47.593133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa513be-636a-45d4-a08c-db75ec7a7c0e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:47.593247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] PATH_INFO: `/v3/users/469019fafd794b54ad25e7b2139ac1e6` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:47.594938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=469019fafd794b54ad25e7b2139ac1e6)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:47.598092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:47.629948 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 876/1762] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:47.635353 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa513be-636a-45d4-a08c-db75ec7a7c0e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:47.640871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-efa513be-636a-45d4-a08c-db75ec7a7c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:47.703009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa513be-636a-45d4-a08c-db75ec7a7c0e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:47.719844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eda96-14c8-4aef-8c4f-e86c844c5ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:47.721576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eda96-14c8-4aef-8c4f-e86c844c5ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:47.721576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eda96-14c8-4aef-8c4f-e86c844c5ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:47.721576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eda96-14c8-4aef-8c4f-e86c844c5ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:47.723526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eda96-14c8-4aef-8c4f-e86c844c5ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:47.726928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eda96-14c8-4aef-8c4f-e86c844c5ae9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:47.729061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469019fafd794b54ad25e7b2139ac1e6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:47.730209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469019fafd794b54ad25e7b2139ac1e6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:47.753593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469019fafd794b54ad25e7b2139ac1e6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:47.766911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 877/1763] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:47.768393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe0aca-55dd-470d-9c38-7c1a05a766b3 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:47.769269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe0aca-55dd-470d-9c38-7c1a05a766b3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:47.769569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe0aca-55dd-470d-9c38-7c1a05a766b3 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:47.774833 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 878/1764] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:32:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:32:47.775733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe0aca-55dd-470d-9c38-7c1a05a766b3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:47.776428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469019fafd794b54ad25e7b2139ac1e6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:47.796827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f35687ec-08e7-47cf-8f9e-10190a087305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469019fafd794b54ad25e7b2139ac1e6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:47.812437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 887/1765] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:47 2022] DELETE /identity/v3/users/469019fafd794b54ad25e7b2139ac1e6 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:47.821847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe0aca-55dd-470d-9c38-7c1a05a766b3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:47.893067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4aa1b-7109-49c7-9eec-e7c01310a160 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:47.894101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4aa1b-7109-49c7-9eec-e7c01310a160 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:47.894284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4aa1b-7109-49c7-9eec-e7c01310a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:47.931527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6ef4aa1b-7109-49c7-9eec-e7c01310a160 None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:47.935393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6ef4aa1b-7109-49c7-9eec-e7c01310a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:47.957988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:48.064123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b36b3-3f67-4da7-b198-023a4c5f5b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:48.069308 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b36b3-3f67-4da7-b198-023a4c5f5b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:48.069998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b36b3-3f67-4da7-b198-023a4c5f5b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:48.070479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b36b3-3f67-4da7-b198-023a4c5f5b76 admin admin] PATH_INFO: `/v3/projects/18348fb7ea3f456eaf72eee2310c74e5/users/e8072b4c7937406db256d2e27303ac7e/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:48.127444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b36b3-3f67-4da7-b198-023a4c5f5b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18348fb7ea3f456eaf72eee2310c74e5, user_id=e8072b4c7937406db256d2e27303ac7e, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:48.149987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b36b3-3f67-4da7-b198-023a4c5f5b76 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:48.187952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 879/1766] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:47 2022] PUT /identity/v3/projects/18348fb7ea3f456eaf72eee2310c74e5/users/e8072b4c7937406db256d2e27303ac7e/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:48.205072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b10f0-5f12-40b4-bcca-a036e91ba190 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:48.213509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b10f0-5f12-40b4-bcca-a036e91ba190 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:48.214041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b10f0-5f12-40b4-bcca-a036e91ba190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:48.286525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 888/1767] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:32:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:48.339382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0d1b10f0-5f12-40b4-bcca-a036e91ba190 None None] MFA Rules not processed for user `e8072b4c7937406db256d2e27303ac7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:48.345335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0d1b10f0-5f12-40b4-bcca-a036e91ba190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:48.375137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92200de-8cb8-4857-8292-3d8bccabcad6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:48.375465 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92200de-8cb8-4857-8292-3d8bccabcad6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:48.375750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92200de-8cb8-4857-8292-3d8bccabcad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:48.424646 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e92200de-8cb8-4857-8292-3d8bccabcad6 None None] MFA Rules not processed for user `6e971595d77647dca5a29a5574c6627d`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:48.429202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e92200de-8cb8-4857-8292-3d8bccabcad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:48.654682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 880/1768] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:48.656337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b10f0-5f12-40b4-bcca-a036e91ba190 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:48.660162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0d1b10f0-5f12-40b4-bcca-a036e91ba190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:48.664377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 889/1769] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:48.668153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92200de-8cb8-4857-8292-3d8bccabcad6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:48.679393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e92200de-8cb8-4857-8292-3d8bccabcad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:48.979718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92200de-8cb8-4857-8292-3d8bccabcad6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:49.002121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88649a-0389-4206-8e02-7326c6052fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:49.003538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88649a-0389-4206-8e02-7326c6052fce admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:49.004053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88649a-0389-4206-8e02-7326c6052fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:49.004535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88649a-0389-4206-8e02-7326c6052fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:49.005830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88649a-0389-4206-8e02-7326c6052fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:49.008175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88649a-0389-4206-8e02-7326c6052fce admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:49.090812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 890/1770] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:48 2022] POST /identity/v3/projects => generated 381 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:49.094477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88649a-0389-4206-8e02-7326c6052fce admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:49.181110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:49.227769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:49.290085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b10f0-5f12-40b4-bcca-a036e91ba190 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:49.326596 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88649a-0389-4206-8e02-7326c6052fce admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:49.345370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4faa8-ff3f-4884-86b0-a5bd9d320ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:49.348795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4faa8-ff3f-4884-86b0-a5bd9d320ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:49.350230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4faa8-ff3f-4884-86b0-a5bd9d320ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:49.351603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4faa8-ff3f-4884-86b0-a5bd9d320ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:49.354242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4faa8-ff3f-4884-86b0-a5bd9d320ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:49.359664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4faa8-ff3f-4884-86b0-a5bd9d320ba9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:49.414767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 891/1771] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:49 2022] POST /identity/v3/users => generated 297 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:49.415963 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4faa8-ff3f-4884-86b0-a5bd9d320ba9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:49.450090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4faa8-ff3f-4884-86b0-a5bd9d320ba9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:49.463641 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caf10a-6f66-4d1d-8a2a-30d2f5ddd590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:49.466380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caf10a-6f66-4d1d-8a2a-30d2f5ddd590 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:49.466905 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caf10a-6f66-4d1d-8a2a-30d2f5ddd590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:49.470435 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caf10a-6f66-4d1d-8a2a-30d2f5ddd590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:49.471481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caf10a-6f66-4d1d-8a2a-30d2f5ddd590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:49.475239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caf10a-6f66-4d1d-8a2a-30d2f5ddd590 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:49.504868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f699-ee0c-4430-9554-e24b85bd686a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:49.505580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f699-ee0c-4430-9554-e24b85bd686a service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:49.505991 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f699-ee0c-4430-9554-e24b85bd686a service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:49.506275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f699-ee0c-4430-9554-e24b85bd686a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:49.517755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 892/1772] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:49.526000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5f699-ee0c-4430-9554-e24b85bd686a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:49.528343 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caf10a-6f66-4d1d-8a2a-30d2f5ddd590 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:49.530299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5f699-ee0c-4430-9554-e24b85bd686a service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:49.569531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 881/1773] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 918 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:49.592003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caf10a-6f66-4d1d-8a2a-30d2f5ddd590 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:49.611188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90086dd0-2853-470f-b411-9d9a932fc927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:49.616273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90086dd0-2853-470f-b411-9d9a932fc927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:49.616568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90086dd0-2853-470f-b411-9d9a932fc927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:49.616841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90086dd0-2853-470f-b411-9d9a932fc927 admin admin] PATH_INFO: `/v3/projects/c6256decf3b547f8ae7bbf4208bf0d29/users/893bac29530f43dc8d6f4e875c8cb915/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:49.701802 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90086dd0-2853-470f-b411-9d9a932fc927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6256decf3b547f8ae7bbf4208bf0d29, user_id=893bac29530f43dc8d6f4e875c8cb915, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:49.715544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90086dd0-2853-470f-b411-9d9a932fc927 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:49.758388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 893/1774] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:49 2022] PUT /identity/v3/projects/c6256decf3b547f8ae7bbf4208bf0d29/users/893bac29530f43dc8d6f4e875c8cb915/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:49.762516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f699-ee0c-4430-9554-e24b85bd686a service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:49.803423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f699-ee0c-4430-9554-e24b85bd686a service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:50.008619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970fca1-1925-464f-9c5b-4e0dc3176dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:50.009595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970fca1-1925-464f-9c5b-4e0dc3176dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:50.010130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970fca1-1925-464f-9c5b-4e0dc3176dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:50.010647 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970fca1-1925-464f-9c5b-4e0dc3176dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:50.011610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970fca1-1925-464f-9c5b-4e0dc3176dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:50.025061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970fca1-1925-464f-9c5b-4e0dc3176dfd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:50.060010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 882/1775] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:50.064670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90086dd0-2853-470f-b411-9d9a932fc927 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:50.080613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90086dd0-2853-470f-b411-9d9a932fc927 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:50.098681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef40cd-ce55-48df-bad9-422e907b2831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:50.100041 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef40cd-ce55-48df-bad9-422e907b2831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:50.100782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef40cd-ce55-48df-bad9-422e907b2831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:50.101260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef40cd-ce55-48df-bad9-422e907b2831 admin admin] PATH_INFO: `/v3/projects/c6256decf3b547f8ae7bbf4208bf0d29/users/893bac29530f43dc8d6f4e875c8cb915/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:50.104189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef40cd-ce55-48df-bad9-422e907b2831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6256decf3b547f8ae7bbf4208bf0d29, user_id=893bac29530f43dc8d6f4e875c8cb915, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:50.108687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef40cd-ce55-48df-bad9-422e907b2831 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:50.140018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 894/1776] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:50 2022] PUT /identity/v3/projects/c6256decf3b547f8ae7bbf4208bf0d29/users/893bac29530f43dc8d6f4e875c8cb915/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:32:50.152050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c78bf-944e-4d73-8cf9-be0602b0c3e2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:50.152478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c78bf-944e-4d73-8cf9-be0602b0c3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:50.153089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c78bf-944e-4d73-8cf9-be0602b0c3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:50.248776 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1e1c78bf-944e-4d73-8cf9-be0602b0c3e2 None None] MFA Rules not processed for user `893bac29530f43dc8d6f4e875c8cb915`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:50.250867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1e1c78bf-944e-4d73-8cf9-be0602b0c3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:50.313440 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3638-ad0c-4e10-97e1-92751a4f4b4c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:50.313884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3638-ad0c-4e10-97e1-92751a4f4b4c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:50.314277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3638-ad0c-4e10-97e1-92751a4f4b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:50.370829 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0cec3638-ad0c-4e10-97e1-92751a4f4b4c None None] MFA Rules not processed for user `6ca2454700fa46dbbfe0fe44bcbc266c`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:50.372833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0cec3638-ad0c-4e10-97e1-92751a4f4b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:50.454690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:50.490987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 883/1777] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:50.504252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c78bf-944e-4d73-8cf9-be0602b0c3e2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:50.507452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1e1c78bf-944e-4d73-8cf9-be0602b0c3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:50.585295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 895/1778] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:32:50.630981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c78bf-944e-4d73-8cf9-be0602b0c3e2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:50.643226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc392e78-96ed-44c7-8336-bd46620a9545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:50.650854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc392e78-96ed-44c7-8336-bd46620a9545 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:50.651280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc392e78-96ed-44c7-8336-bd46620a9545 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:50.651596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc392e78-96ed-44c7-8336-bd46620a9545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:50.688643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc392e78-96ed-44c7-8336-bd46620a9545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:50.691829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc392e78-96ed-44c7-8336-bd46620a9545 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:50.722794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 884/1779] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:50.967481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec3638-ad0c-4e10-97e1-92751a4f4b4c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:50.995768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec3638-ad0c-4e10-97e1-92751a4f4b4c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:51.007322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cd1a9-0d85-46e1-b347-bb0bc890524c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:51.008692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cd1a9-0d85-46e1-b347-bb0bc890524c service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:51.009259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cd1a9-0d85-46e1-b347-bb0bc890524c service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:51.009862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cd1a9-0d85-46e1-b347-bb0bc890524c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:51.291974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cd1a9-0d85-46e1-b347-bb0bc890524c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:51.296704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cd1a9-0d85-46e1-b347-bb0bc890524c service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:51.333203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 896/1780] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:51.408994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc392e78-96ed-44c7-8336-bd46620a9545 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:51.411804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bc392e78-96ed-44c7-8336-bd46620a9545 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:51.671742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc392e78-96ed-44c7-8336-bd46620a9545 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:51.695176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:51.696203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:51.696566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:51.696845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] PATH_INFO: `/v3/users/df8a0ed1a9f54542b8c3dee94ccdbfe7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:51.713881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8a0ed1a9f54542b8c3dee94ccdbfe7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:51.723140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:51.928878 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8a0ed1a9f54542b8c3dee94ccdbfe7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:51.934809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8a0ed1a9f54542b8c3dee94ccdbfe7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:51.936124 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8a0ed1a9f54542b8c3dee94ccdbfe7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:52.004337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8a0ed1a9f54542b8c3dee94ccdbfe7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:52.025703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8a0ed1a9f54542b8c3dee94ccdbfe7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:52.082693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 885/1781] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:51 2022] DELETE /identity/v3/users/df8a0ed1a9f54542b8c3dee94ccdbfe7 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:52.087036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2164dac-2ad3-4d66-ad92-72141714d929 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:52.087760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2164dac-2ad3-4d66-ad92-72141714d929 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:52.088930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2164dac-2ad3-4d66-ad92-72141714d929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:52.125251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f2164dac-2ad3-4d66-ad92-72141714d929 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:52.127011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f2164dac-2ad3-4d66-ad92-72141714d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:52.193809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:52.393857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 897/1782] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:52.488662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:52.492482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:52.553068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:52.700737 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f6e82-aecc-4d00-9d7c-044552477ff1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:52.717708 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14177990-97c4-4a59-9841-528e5527a79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:52.718411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14177990-97c4-4a59-9841-528e5527a79d service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:52.718731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14177990-97c4-4a59-9841-528e5527a79d service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:52.719009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14177990-97c4-4a59-9841-528e5527a79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:52.756175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14177990-97c4-4a59-9841-528e5527a79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:52.757725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14177990-97c4-4a59-9841-528e5527a79d service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:52.783856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 886/1783] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:53.480406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2164dac-2ad3-4d66-ad92-72141714d929 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:53.482026 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f2164dac-2ad3-4d66-ad92-72141714d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:53.531499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2164dac-2ad3-4d66-ad92-72141714d929 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:53.547588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:53.549355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:53.553608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:53.555123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] PATH_INFO: `/v3/projects/279adadca37b49cca7f7f8a9ffc8aec7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:53.558200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=279adadca37b49cca7f7f8a9ffc8aec7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:53.566772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:53.707095 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279adadca37b49cca7f7f8a9ffc8aec7', 'request_id': 'req-bf664152-7a2f-44e8-8a72-67097e5d60fc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:53.717524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279adadca37b49cca7f7f8a9ffc8aec7', 'request_id': 'req-bf664152-7a2f-44e8-8a72-67097e5d60fc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:53.726204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279adadca37b49cca7f7f8a9ffc8aec7', 'request_id': 'req-bf664152-7a2f-44e8-8a72-67097e5d60fc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:53.743887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] The token cache is being invalidate because project 279adadca37b49cca7f7f8a9ffc8aec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:53.744281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:53.744941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bf664152-7a2f-44e8-8a72-67097e5d60fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:53.746774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 898/1784] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:53 2022] DELETE /identity/v3/projects/279adadca37b49cca7f7f8a9ffc8aec7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:53.754706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2cf4a-9301-4712-a7fd-2c4185fa3fe9 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:53.755361 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2cf4a-9301-4712-a7fd-2c4185fa3fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:53.755361 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2cf4a-9301-4712-a7fd-2c4185fa3fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:53.802403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-77d2cf4a-9301-4712-a7fd-2c4185fa3fe9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:53.805066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-77d2cf4a-9301-4712-a7fd-2c4185fa3fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:54.010523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4f92-38da-43e3-a966-11374ad8b2e7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:54.011810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4f92-38da-43e3-a966-11374ad8b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:54.012814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4f92-38da-43e3-a966-11374ad8b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:54.031815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 887/1785] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:54.062184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c8ea4f92-38da-43e3-a966-11374ad8b2e7 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:54.064105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c8ea4f92-38da-43e3-a966-11374ad8b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:54.087124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 899/1786] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:54.088476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2cf4a-9301-4712-a7fd-2c4185fa3fe9 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:54.104805 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2cf4a-9301-4712-a7fd-2c4185fa3fe9 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:54.120927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d459d-8d51-463a-b0fa-362097f4530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:54.123718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d459d-8d51-463a-b0fa-362097f4530f admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:54.124053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d459d-8d51-463a-b0fa-362097f4530f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:54.127306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d459d-8d51-463a-b0fa-362097f4530f admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:54.128478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d459d-8d51-463a-b0fa-362097f4530f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:54.130720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d459d-8d51-463a-b0fa-362097f4530f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:54.134873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d459d-8d51-463a-b0fa-362097f4530f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:54.167518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 888/1787] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:54.172126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4f92-38da-43e3-a966-11374ad8b2e7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:54.186552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4f92-38da-43e3-a966-11374ad8b2e7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:54.196260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae69b9-6293-42d2-9593-7d059e0ed6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:54.197531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae69b9-6293-42d2-9593-7d059e0ed6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:54.198065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae69b9-6293-42d2-9593-7d059e0ed6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:54.199307 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae69b9-6293-42d2-9593-7d059e0ed6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:54.200466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae69b9-6293-42d2-9593-7d059e0ed6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:54.203024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae69b9-6293-42d2-9593-7d059e0ed6c4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:54.254408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 900/1788] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:54 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:32:54.257545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d459d-8d51-463a-b0fa-362097f4530f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:54.271670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d459d-8d51-463a-b0fa-362097f4530f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:54.387085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9005d4-c473-4c77-9a38-f783281d3be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:54.387786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9005d4-c473-4c77-9a38-f783281d3be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:54.388245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9005d4-c473-4c77-9a38-f783281d3be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:54.388808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9005d4-c473-4c77-9a38-f783281d3be1 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:54.389647 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9005d4-c473-4c77-9a38-f783281d3be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:54.391728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9005d4-c473-4c77-9a38-f783281d3be1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:54.429186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 889/1789] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:54 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:54.429403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae69b9-6293-42d2-9593-7d059e0ed6c4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:54.444427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae69b9-6293-42d2-9593-7d059e0ed6c4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:54.451883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d98942-f953-4e67-9ab1-c0a896c930d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:54.452575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d98942-f953-4e67-9ab1-c0a896c930d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:54.453058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d98942-f953-4e67-9ab1-c0a896c930d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:54.453386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d98942-f953-4e67-9ab1-c0a896c930d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:54.454233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d98942-f953-4e67-9ab1-c0a896c930d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:54.459031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d98942-f953-4e67-9ab1-c0a896c930d9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:54.476138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 901/1790] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:54.481122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9005d4-c473-4c77-9a38-f783281d3be1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:54.493873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9005d4-c473-4c77-9a38-f783281d3be1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:54.501323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261a183-b828-4c71-af43-6a0deb52aee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:54.502018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a183-b828-4c71-af43-6a0deb52aee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:54.502305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a183-b828-4c71-af43-6a0deb52aee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:54.502619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a183-b828-4c71-af43-6a0deb52aee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:54.503458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261a183-b828-4c71-af43-6a0deb52aee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:54.505142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261a183-b828-4c71-af43-6a0deb52aee4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:54.524150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d98942-f953-4e67-9ab1-c0a896c930d9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:54.544881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 890/1791] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:54.550711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d98942-f953-4e67-9ab1-c0a896c930d9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:54.565462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464df50-f3be-4a6e-a075-b2b2f26826e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:54.566615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464df50-f3be-4a6e-a075-b2b2f26826e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:54.568614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464df50-f3be-4a6e-a075-b2b2f26826e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:54.568859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464df50-f3be-4a6e-a075-b2b2f26826e9 admin admin] PATH_INFO: `/v3/projects/9b3675a3f04e47cc817271f19b3979ff/users/865ddd5c0b284fa48a3e61565a91558a/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:54.607710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464df50-f3be-4a6e-a075-b2b2f26826e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3675a3f04e47cc817271f19b3979ff, user_id=865ddd5c0b284fa48a3e61565a91558a, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:54.611866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464df50-f3be-4a6e-a075-b2b2f26826e9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:54.651687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 902/1792] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:54 2022] PUT /identity/v3/projects/9b3675a3f04e47cc817271f19b3979ff/users/865ddd5c0b284fa48a3e61565a91558a/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:54.652057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a522-744b-48a0-ae48-2a27ac971e69 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:54.652466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a522-744b-48a0-ae48-2a27ac971e69 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:54.652745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a522-744b-48a0-ae48-2a27ac971e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:54.683165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6354a522-744b-48a0-ae48-2a27ac971e69 None None] MFA Rules not processed for user `865ddd5c0b284fa48a3e61565a91558a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:54.684417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6354a522-744b-48a0-ae48-2a27ac971e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:54.701042 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:54.788279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 891/1793] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:54.789135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464df50-f3be-4a6e-a075-b2b2f26826e9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:54.840232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:54.866068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464df50-f3be-4a6e-a075-b2b2f26826e9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:54.872706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650bc3b-ca5d-4b33-85f4-fe4a192b085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:54.873866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650bc3b-ca5d-4b33-85f4-fe4a192b085c admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:54.874002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650bc3b-ca5d-4b33-85f4-fe4a192b085c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:54.874404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650bc3b-ca5d-4b33-85f4-fe4a192b085c admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:54.875431 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650bc3b-ca5d-4b33-85f4-fe4a192b085c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:54.879837 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650bc3b-ca5d-4b33-85f4-fe4a192b085c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:54.924395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354a522-744b-48a0-ae48-2a27ac971e69 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:54.925972 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6354a522-744b-48a0-ae48-2a27ac971e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:54.934007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 903/1794] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:54 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:32:54.935162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650bc3b-ca5d-4b33-85f4-fe4a192b085c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:54.960077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354a522-744b-48a0-ae48-2a27ac971e69 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:55.040842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650bc3b-ca5d-4b33-85f4-fe4a192b085c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:55.063039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c96b6-7cbc-4319-a59e-6ec6340888e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:55.065536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c96b6-7cbc-4319-a59e-6ec6340888e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:55.072752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c96b6-7cbc-4319-a59e-6ec6340888e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:55.073661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c96b6-7cbc-4319-a59e-6ec6340888e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:55.077614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c96b6-7cbc-4319-a59e-6ec6340888e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:55.086804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c96b6-7cbc-4319-a59e-6ec6340888e5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:55.142774 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:55.145980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:55.147615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:55.149260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] PATH_INFO: `/v3/projects/bba60f8bae524c35b70ddd480f734834` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:55.156252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 904/1795] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:54 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:55.156377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba60f8bae524c35b70ddd480f734834)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:55.159979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:55.160117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c96b6-7cbc-4319-a59e-6ec6340888e5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:55.199678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c96b6-7cbc-4319-a59e-6ec6340888e5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:55.215837 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bbe8d-db0a-44d3-b021-7beea0c8c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:55.216615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bbe8d-db0a-44d3-b021-7beea0c8c873 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:55.216902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bbe8d-db0a-44d3-b021-7beea0c8c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:55.217928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bbe8d-db0a-44d3-b021-7beea0c8c873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:55.218857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bbe8d-db0a-44d3-b021-7beea0c8c873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:55.220763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bbe8d-db0a-44d3-b021-7beea0c8c873 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:55.247664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 905/1796] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:55.249133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97178679-0b5f-4c3f-99a9-97323d514cb6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:55.249426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97178679-0b5f-4c3f-99a9-97323d514cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:55.249710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97178679-0b5f-4c3f-99a9-97323d514cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:55.283465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba60f8bae524c35b70ddd480f734834', 'request_id': 'req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:55.293441 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-97178679-0b5f-4c3f-99a9-97323d514cb6 None None] MFA Rules not processed for user `4a4e638dc0dd459699b76df35568e795`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:55.295568 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba60f8bae524c35b70ddd480f734834', 'request_id': 'req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:55.296718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-97178679-0b5f-4c3f-99a9-97323d514cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:55.307482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba60f8bae524c35b70ddd480f734834', 'request_id': 'req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:55.354145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] The token cache is being invalidate because project bba60f8bae524c35b70ddd480f734834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:55.354510 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:55.357098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:55.407104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 892/1797] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:54 2022] DELETE /identity/v3/projects/bba60f8bae524c35b70ddd480f734834 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:55.408119 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:55.419222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:55.509005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:55.525521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 906/1798] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:55.526592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97178679-0b5f-4c3f-99a9-97323d514cb6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:55.529519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-97178679-0b5f-4c3f-99a9-97323d514cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:55.541585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccbaaf-6a25-4dbe-8a47-13fd7f08cd99 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:55.558672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:55.560784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:55.561293 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:55.561933 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] PATH_INFO: `/v3/users/e8072b4c7937406db256d2e27303ac7e` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:55.563626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8072b4c7937406db256d2e27303ac7e)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:55.566617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97178679-0b5f-4c3f-99a9-97323d514cb6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:55.567715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:55.589168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e887c-b9c4-483a-a09e-579c37783ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:55.591366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e887c-b9c4-483a-a09e-579c37783ace admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:55.592466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e887c-b9c4-483a-a09e-579c37783ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:55.593426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e887c-b9c4-483a-a09e-579c37783ace admin admin] PATH_INFO: `/v3/projects/9c0450a647ad46eea1fd6f5291b30d81/users/4723e65c378f42f48f8de1e66236e061/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:55.634950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e887c-b9c4-483a-a09e-579c37783ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0450a647ad46eea1fd6f5291b30d81, user_id=4723e65c378f42f48f8de1e66236e061, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:55.644356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e887c-b9c4-483a-a09e-579c37783ace admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:55.686843 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 907/1799] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:55 2022] PUT /identity/v3/projects/9c0450a647ad46eea1fd6f5291b30d81/users/4723e65c378f42f48f8de1e66236e061/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:55.687849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e887c-b9c4-483a-a09e-579c37783ace admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:55.691972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-612e887c-b9c4-483a-a09e-579c37783ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:55.720898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8072b4c7937406db256d2e27303ac7e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:55.722582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8072b4c7937406db256d2e27303ac7e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:55.723318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8072b4c7937406db256d2e27303ac7e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:55.763105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:55.788975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8072b4c7937406db256d2e27303ac7e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:55.814528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8072b4c7937406db256d2e27303ac7e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:55.849715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 893/1800] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:55 2022] DELETE /identity/v3/users/e8072b4c7937406db256d2e27303ac7e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:55.850738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:55.857152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:55.879969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e887c-b9c4-483a-a09e-579c37783ace admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:56.038529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:56.039401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:56.039692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:56.040022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] PATH_INFO: `/v3/users/24cd8dce3f5d449ba17d19f57b145656` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:56.041349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=24cd8dce3f5d449ba17d19f57b145656)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:56.043470 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:56.081920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632de31-5667-4273-b1d0-3271c07f8310 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:56.101639 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b929b-e893-40ae-87da-dd8e8248fed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:56.105271 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b929b-e893-40ae-87da-dd8e8248fed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:56.105989 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b929b-e893-40ae-87da-dd8e8248fed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:56.105989 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b929b-e893-40ae-87da-dd8e8248fed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:56.109625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b929b-e893-40ae-87da-dd8e8248fed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:56.119961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b929b-e893-40ae-87da-dd8e8248fed7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:56.155953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 894/1801] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:56.162319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293c1aa-239f-485f-9cac-82898d55da03 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:56.162673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293c1aa-239f-485f-9cac-82898d55da03 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:56.162959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293c1aa-239f-485f-9cac-82898d55da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:56.166862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24cd8dce3f5d449ba17d19f57b145656'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:56.167860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24cd8dce3f5d449ba17d19f57b145656'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:56.193387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24cd8dce3f5d449ba17d19f57b145656'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:56.212449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24cd8dce3f5d449ba17d19f57b145656'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:56.223228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24cd8dce3f5d449ba17d19f57b145656'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:56.225310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0293c1aa-239f-485f-9cac-82898d55da03 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:56.226596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0293c1aa-239f-485f-9cac-82898d55da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:56.233860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 908/1802] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:55 2022] DELETE /identity/v3/users/24cd8dce3f5d449ba17d19f57b145656 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:56.234976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:56.236625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:56.302113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:56.336862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337757-403b-4b61-bc63-0db89d6bc02d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:56.349688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cab2b-c3fd-48e1-a81e-8e47dda8307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:56.350895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cab2b-c3fd-48e1-a81e-8e47dda8307c admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:56.351332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cab2b-c3fd-48e1-a81e-8e47dda8307c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:56.351764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cab2b-c3fd-48e1-a81e-8e47dda8307c admin admin] PATH_INFO: `/v3/projects/9c0450a647ad46eea1fd6f5291b30d81/users/4723e65c378f42f48f8de1e66236e061/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:56.357009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cab2b-c3fd-48e1-a81e-8e47dda8307c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0450a647ad46eea1fd6f5291b30d81, user_id=4723e65c378f42f48f8de1e66236e061, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:56.360891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cab2b-c3fd-48e1-a81e-8e47dda8307c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:56.392721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 909/1803] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:56 2022] PUT /identity/v3/projects/9c0450a647ad46eea1fd6f5291b30d81/users/4723e65c378f42f48f8de1e66236e061/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:56.404916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55873a9b-b8cf-4173-8426-0557372f977b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:56.405480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55873a9b-b8cf-4173-8426-0557372f977b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:56.406769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55873a9b-b8cf-4173-8426-0557372f977b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:56.454492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:56.464035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-55873a9b-b8cf-4173-8426-0557372f977b None None] MFA Rules not processed for user `4723e65c378f42f48f8de1e66236e061`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:56.465652 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-55873a9b-b8cf-4173-8426-0557372f977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:56.501168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 895/1804] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:56.631278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 910/1805] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:56.642888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293c1aa-239f-485f-9cac-82898d55da03 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:56.645483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0293c1aa-239f-485f-9cac-82898d55da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:56.796565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293c1aa-239f-485f-9cac-82898d55da03 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:56.918496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c89a0-28bb-479e-9a95-0db4cbd95776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:56.919684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c89a0-28bb-479e-9a95-0db4cbd95776 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:56.920701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c89a0-28bb-479e-9a95-0db4cbd95776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:56.921150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c89a0-28bb-479e-9a95-0db4cbd95776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:56.935266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c89a0-28bb-479e-9a95-0db4cbd95776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:56.937053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c89a0-28bb-479e-9a95-0db4cbd95776 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:56.953925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 896/1806] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:57.020019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55873a9b-b8cf-4173-8426-0557372f977b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:57.036519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-55873a9b-b8cf-4173-8426-0557372f977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:57.055258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c89a0-28bb-479e-9a95-0db4cbd95776 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:57.057688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-263c89a0-28bb-479e-9a95-0db4cbd95776 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:57.281001 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55873a9b-b8cf-4173-8426-0557372f977b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:57.295593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87412e8-8411-468a-b58e-ddc18ae46663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:57.297213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87412e8-8411-468a-b58e-ddc18ae46663 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:57.297870 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87412e8-8411-468a-b58e-ddc18ae46663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:57.298159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87412e8-8411-468a-b58e-ddc18ae46663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:57.322465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c89a0-28bb-479e-9a95-0db4cbd95776 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:57.329707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87412e8-8411-468a-b58e-ddc18ae46663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:57.335069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87412e8-8411-468a-b58e-ddc18ae46663 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:57.343331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:57.343331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:57.343331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:57.343331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] PATH_INFO: `/v3/projects/954b19e03fda43da938cb8426c7edc4f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:57.348751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=954b19e03fda43da938cb8426c7edc4f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:57.361889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:57.389189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 911/1807] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:32:57.466068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954b19e03fda43da938cb8426c7edc4f', 'request_id': 'req-7fbb33aa-e04a-47a8-9551-238e3d424c9d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:57.485133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954b19e03fda43da938cb8426c7edc4f', 'request_id': 'req-7fbb33aa-e04a-47a8-9551-238e3d424c9d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:57.488953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:57.497560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954b19e03fda43da938cb8426c7edc4f', 'request_id': 'req-7fbb33aa-e04a-47a8-9551-238e3d424c9d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:57.529259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] The token cache is being invalidate because project 954b19e03fda43da938cb8426c7edc4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:57.529541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:57.536997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:57.541293 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 897/1808] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:57 2022] DELETE /identity/v3/projects/954b19e03fda43da938cb8426c7edc4f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:57.547069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566ffa-207f-4e27-b9cc-111b8c088fff None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:57.547544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566ffa-207f-4e27-b9cc-111b8c088fff None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:57.547751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566ffa-207f-4e27-b9cc-111b8c088fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:57.587553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1d566ffa-207f-4e27-b9cc-111b8c088fff None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:57.588806 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1d566ffa-207f-4e27-b9cc-111b8c088fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:57.671660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:57.673359 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:57.739484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 912/1809] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:57.744604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17895bf-5a3c-47ba-bae7-d2bed7818678 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:57.745493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17895bf-5a3c-47ba-bae7-d2bed7818678 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:57.745493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17895bf-5a3c-47ba-bae7-d2bed7818678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:57.795665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c17895bf-5a3c-47ba-bae7-d2bed7818678 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:57.797498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c17895bf-5a3c-47ba-bae7-d2bed7818678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:57.829804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 913/1810] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:57.834524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0cd6c-e6e9-4f15-b6c5-d6a8a08833c6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:57.834813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0cd6c-e6e9-4f15-b6c5-d6a8a08833c6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:57.835090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0cd6c-e6e9-4f15-b6c5-d6a8a08833c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:57.836913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb33aa-e04a-47a8-9551-238e3d424c9d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:57.849357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904586ee-4c3e-4284-9eea-ee3f94eafd84 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4723e65c378f42f48f8de1e66236e061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c0450a647ad46eea1fd6f5291b30d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:57.850247 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904586ee-4c3e-4284-9eea-ee3f94eafd84 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:57.850809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904586ee-4c3e-4284-9eea-ee3f94eafd84 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:57.851129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904586ee-4c3e-4284-9eea-ee3f94eafd84 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:57.852463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:57.853235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904586ee-4c3e-4284-9eea-ee3f94eafd84 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:57.853554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904586ee-4c3e-4284-9eea-ee3f94eafd84 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:57.858782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904586ee-4c3e-4284-9eea-ee3f94eafd84 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:57.887855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-94d0cd6c-e6e9-4f15-b6c5-d6a8a08833c6 None None] MFA Rules not processed for user `1b925b5e87dc489db1dd5e994e47e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:57.892806 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-94d0cd6c-e6e9-4f15-b6c5-d6a8a08833c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:57.910480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 898/1811] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:32:57.915106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904586ee-4c3e-4284-9eea-ee3f94eafd84 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:57.944178 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904586ee-4c3e-4284-9eea-ee3f94eafd84 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:57.951458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c3dfd-1bae-4d0d-bc4f-f37abac18c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:57.953070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c3dfd-1bae-4d0d-bc4f-f37abac18c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:57.953475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c3dfd-1bae-4d0d-bc4f-f37abac18c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:57.953859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c3dfd-1bae-4d0d-bc4f-f37abac18c71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:57.954846 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c3dfd-1bae-4d0d-bc4f-f37abac18c71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:57.955449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c3dfd-1bae-4d0d-bc4f-f37abac18c71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:57.957983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c3dfd-1bae-4d0d-bc4f-f37abac18c71 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:57.974927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 899/1812] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:57.975918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c3dfd-1bae-4d0d-bc4f-f37abac18c71 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:57.984582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 914/1813] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:57.985714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0cd6c-e6e9-4f15-b6c5-d6a8a08833c6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:57.998557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0cd6c-e6e9-4f15-b6c5-d6a8a08833c6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:58.004423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcce73-fc8c-4195-877d-66649a0cd09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:58.005167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcce73-fc8c-4195-877d-66649a0cd09e admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.005461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcce73-fc8c-4195-877d-66649a0cd09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.005743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcce73-fc8c-4195-877d-66649a0cd09e admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.006749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcce73-fc8c-4195-877d-66649a0cd09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:58.006867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c3dfd-1bae-4d0d-bc4f-f37abac18c71 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:58.008462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcce73-fc8c-4195-877d-66649a0cd09e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:58.013153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fa65-4bdf-45f0-804c-c334246d2dc7 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4723e65c378f42f48f8de1e66236e061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c0450a647ad46eea1fd6f5291b30d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:58.013381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fa65-4bdf-45f0-804c-c334246d2dc7 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.013771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fa65-4bdf-45f0-804c-c334246d2dc7 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.014194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fa65-4bdf-45f0-804c-c334246d2dc7 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.015061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3fa65-4bdf-45f0-804c-c334246d2dc7 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:58.017171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3fa65-4bdf-45f0-804c-c334246d2dc7 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:58.047613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 915/1814] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:57 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:58.052974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcce73-fc8c-4195-877d-66649a0cd09e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:58.101211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 900/1815] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:57 2022] POST /identity/v3/projects => generated 354 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:58.105498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fa65-4bdf-45f0-804c-c334246d2dc7 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:58.187873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcce73-fc8c-4195-877d-66649a0cd09e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:58.254630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fa65-4bdf-45f0-804c-c334246d2dc7 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:58.260393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fd95-89aa-43b6-9c73-b7d367155251 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4723e65c378f42f48f8de1e66236e061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c0450a647ad46eea1fd6f5291b30d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:58.262803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fd95-89aa-43b6-9c73-b7d367155251 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.262803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fd95-89aa-43b6-9c73-b7d367155251 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.262803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fd95-89aa-43b6-9c73-b7d367155251 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.263773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622fd95-89aa-43b6-9c73-b7d367155251 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:32:58.263773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622fd95-89aa-43b6-9c73-b7d367155251 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:58.266296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622fd95-89aa-43b6-9c73-b7d367155251 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:58.282388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 901/1816] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:32:58.283248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fd95-89aa-43b6-9c73-b7d367155251 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:58.284979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8622fd95-89aa-43b6-9c73-b7d367155251 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:58.293411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b170b5-78f9-4594-a181-841458de001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:58.294640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b170b5-78f9-4594-a181-841458de001a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.295123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b170b5-78f9-4594-a181-841458de001a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.295605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b170b5-78f9-4594-a181-841458de001a admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.296610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b170b5-78f9-4594-a181-841458de001a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:58.300442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b170b5-78f9-4594-a181-841458de001a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:58.345768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 916/1817] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:58 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:32:58.346850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b170b5-78f9-4594-a181-841458de001a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:58.349218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fd95-89aa-43b6-9c73-b7d367155251 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:58.358850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:58.360825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.361194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.361807 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] PATH_INFO: `/v3/projects/18348fb7ea3f456eaf72eee2310c74e5` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.364614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18348fb7ea3f456eaf72eee2310c74e5)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:58.369628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b170b5-78f9-4594-a181-841458de001a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:58.376312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fbc37-4ecd-4de3-9c10-8b9d77d4fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:58.377476 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fbc37-4ecd-4de3-9c10-8b9d77d4fe69 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.377476 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fbc37-4ecd-4de3-9c10-8b9d77d4fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.377822 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fbc37-4ecd-4de3-9c10-8b9d77d4fe69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.379676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fbc37-4ecd-4de3-9c10-8b9d77d4fe69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:58.381296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:58.382755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fbc37-4ecd-4de3-9c10-8b9d77d4fe69 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:58.400667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 917/1818] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:58.404952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fbc37-4ecd-4de3-9c10-8b9d77d4fe69 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:58.421979 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fbc37-4ecd-4de3-9c10-8b9d77d4fe69 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:58.431322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4723e65c378f42f48f8de1e66236e061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c0450a647ad46eea1fd6f5291b30d81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:58.432657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.433130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.433583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] PATH_INFO: `/v3/projects/2e8adbefdb1649838dd7023882cd6e9a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.435399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2e8adbefdb1649838dd7023882cd6e9a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:58.437706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:58.453818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:58.480559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:58.499000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18348fb7ea3f456eaf72eee2310c74e5', 'request_id': 'req-9d60f803-353f-46a2-b5df-a7d01fb15298'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.510567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18348fb7ea3f456eaf72eee2310c74e5', 'request_id': 'req-9d60f803-353f-46a2-b5df-a7d01fb15298'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.520113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18348fb7ea3f456eaf72eee2310c74e5', 'request_id': 'req-9d60f803-353f-46a2-b5df-a7d01fb15298'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.531340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8adbefdb1649838dd7023882cd6e9a', 'request_id': 'req-e2502097-fbbc-4cb7-86af-5900b133dc55'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.543103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] The token cache is being invalidate because project 18348fb7ea3f456eaf72eee2310c74e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:58.544294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.545145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.548642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 902/1819] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:58 2022] DELETE /identity/v3/projects/18348fb7ea3f456eaf72eee2310c74e5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:58.553310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:58.554915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:58.569553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8adbefdb1649838dd7023882cd6e9a', 'request_id': 'req-e2502097-fbbc-4cb7-86af-5900b133dc55'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.584594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8adbefdb1649838dd7023882cd6e9a', 'request_id': 'req-e2502097-fbbc-4cb7-86af-5900b133dc55'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.609093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] The token cache is being invalidate because project 2e8adbefdb1649838dd7023882cd6e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:32:58.609433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.610392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.612977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 918/1820] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:32:58 2022] DELETE /identity/v3/projects/2e8adbefdb1649838dd7023882cd6e9a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:58.614333 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:58.619037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:58.668333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60f803-353f-46a2-b5df-a7d01fb15298 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:58.744266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2502097-fbbc-4cb7-86af-5900b133dc55 tempest-VolumeQuotaClassesTest-1381065851 tempest-VolumeQuotaClassesTest-1381065851-project-admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:58.756706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:58.757739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.758040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.758315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] PATH_INFO: `/v3/users/893bac29530f43dc8d6f4e875c8cb915` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.760507 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893bac29530f43dc8d6f4e875c8cb915)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:58.765555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:58.771668 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ef96e-ef17-497e-89dd-1f106577144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:58.772352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ef96e-ef17-497e-89dd-1f106577144c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.772634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ef96e-ef17-497e-89dd-1f106577144c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.772911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ef96e-ef17-497e-89dd-1f106577144c admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.773782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ef96e-ef17-497e-89dd-1f106577144c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:58.775803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ef96e-ef17-497e-89dd-1f106577144c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:58.797018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 903/1821] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:32:58.798197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ef96e-ef17-497e-89dd-1f106577144c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:58.804698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a62ef96e-ef17-497e-89dd-1f106577144c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:58.848254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ef96e-ef17-497e-89dd-1f106577144c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:58.857080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b666f26-a566-4d75-ae67-09d77f2d1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:58.858452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b666f26-a566-4d75-ae67-09d77f2d1637 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.859946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b666f26-a566-4d75-ae67-09d77f2d1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.860802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b666f26-a566-4d75-ae67-09d77f2d1637 admin admin] PATH_INFO: `/v3/projects/b5d334bc0baa4664ac32c2e472934ad6/users/e7ad575e57ed46bf998e8855b9a2c451/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.869118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893bac29530f43dc8d6f4e875c8cb915'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.869977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893bac29530f43dc8d6f4e875c8cb915'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.883283 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b666f26-a566-4d75-ae67-09d77f2d1637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d334bc0baa4664ac32c2e472934ad6, user_id=e7ad575e57ed46bf998e8855b9a2c451, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:58.886920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893bac29530f43dc8d6f4e875c8cb915'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.887991 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b666f26-a566-4d75-ae67-09d77f2d1637 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:58.917575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893bac29530f43dc8d6f4e875c8cb915'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.918819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 904/1822] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:32:58 2022] PUT /identity/v3/projects/b5d334bc0baa4664ac32c2e472934ad6/users/e7ad575e57ed46bf998e8855b9a2c451/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:58.921456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b256df0-48b2-4ba4-a930-44d37a30c186 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:58.921980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b256df0-48b2-4ba4-a930-44d37a30c186 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:58.922534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b256df0-48b2-4ba4-a930-44d37a30c186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:58.926464 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893bac29530f43dc8d6f4e875c8cb915'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:58.947534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 919/1823] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:58 2022] DELETE /identity/v3/users/893bac29530f43dc8d6f4e875c8cb915 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:58.968964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4b256df0-48b2-4ba4-a930-44d37a30c186 None None] MFA Rules not processed for user `e7ad575e57ed46bf998e8855b9a2c451`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:58.988499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4b256df0-48b2-4ba4-a930-44d37a30c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:59.117641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:59.162218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:59.163871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:59.208227 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:59.220562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 905/1824] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:59.224812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b256df0-48b2-4ba4-a930-44d37a30c186 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:59.226583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4b256df0-48b2-4ba4-a930-44d37a30c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:59.306893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d707f8-a17e-49ce-a31e-d94d7584f9b2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:59.327426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:59.328601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:59.329089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:59.329582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] PATH_INFO: `/v3/users/865ddd5c0b284fa48a3e61565a91558a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:59.331928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=865ddd5c0b284fa48a3e61565a91558a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:59.337007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:59.422914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b256df0-48b2-4ba4-a930-44d37a30c186 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:59.434502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c859ea4-da51-45e1-9c70-fd941d06b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:59.436737 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c859ea4-da51-45e1-9c70-fd941d06b845 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:59.437031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c859ea4-da51-45e1-9c70-fd941d06b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:59.438585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c859ea4-da51-45e1-9c70-fd941d06b845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:59.450567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c859ea4-da51-45e1-9c70-fd941d06b845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:59.450567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c859ea4-da51-45e1-9c70-fd941d06b845 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:59.477852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865ddd5c0b284fa48a3e61565a91558a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:59.480742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865ddd5c0b284fa48a3e61565a91558a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:59.509994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865ddd5c0b284fa48a3e61565a91558a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:59.516892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 906/1825] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:32:59 2022] POST /identity/v3/projects => generated 365 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:32:59.521964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c859ea4-da51-45e1-9c70-fd941d06b845 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:59.555636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865ddd5c0b284fa48a3e61565a91558a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:59.574039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cd285715-1945-4f28-8b7d-dc8ba7f162c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865ddd5c0b284fa48a3e61565a91558a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:32:59.588472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 920/1826] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:32:59 2022] DELETE /identity/v3/users/865ddd5c0b284fa48a3e61565a91558a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:32:59.595210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26413e69-6b6e-4544-abf9-8473809413e9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:59.595835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26413e69-6b6e-4544-abf9-8473809413e9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:59.596317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26413e69-6b6e-4544-abf9-8473809413e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:59.669163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-26413e69-6b6e-4544-abf9-8473809413e9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:32:59.671248 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-26413e69-6b6e-4544-abf9-8473809413e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:59.762129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c859ea4-da51-45e1-9c70-fd941d06b845 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:32:59.843733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 921/1827] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:32:59.908557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26413e69-6b6e-4544-abf9-8473809413e9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:59.911263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-26413e69-6b6e-4544-abf9-8473809413e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:32:59.923379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6d435-3795-4ded-9b8d-d0488dce2cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:32:59.930735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d435-3795-4ded-9b8d-d0488dce2cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:32:59.934283 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d435-3795-4ded-9b8d-d0488dce2cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:32:59.934655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d435-3795-4ded-9b8d-d0488dce2cbe admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:32:59.935362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6d435-3795-4ded-9b8d-d0488dce2cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:32:59.939767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6d435-3795-4ded-9b8d-d0488dce2cbe admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:32:59.963071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:59.987252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 907/1828] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:32:59 2022] POST /identity/v3/users => generated 289 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:32:59.989468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6d435-3795-4ded-9b8d-d0488dce2cbe admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:32:59.992125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a5b6d435-3795-4ded-9b8d-d0488dce2cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:00.016077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:00.019980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6d435-3795-4ded-9b8d-d0488dce2cbe admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:00.036222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeeed7-8a7e-4d73-8e87-eb0d774a8305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:00.039074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeeed7-8a7e-4d73-8e87-eb0d774a8305 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:00.039074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeeed7-8a7e-4d73-8e87-eb0d774a8305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:00.039278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeeed7-8a7e-4d73-8e87-eb0d774a8305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:00.040024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdeeed7-8a7e-4d73-8e87-eb0d774a8305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:00.041690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdeeed7-8a7e-4d73-8e87-eb0d774a8305 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:00.080009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26413e69-6b6e-4544-abf9-8473809413e9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:00.086375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 908/1829] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:00.089353 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324b30e-5f66-43f7-9bba-b914ddf43d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:00.091376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b30e-5f66-43f7-9bba-b914ddf43d82 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:00.092119 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeeed7-8a7e-4d73-8e87-eb0d774a8305 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:00.093283 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b30e-5f66-43f7-9bba-b914ddf43d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:00.094221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b30e-5f66-43f7-9bba-b914ddf43d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:00.115718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeeed7-8a7e-4d73-8e87-eb0d774a8305 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:00.120584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324b30e-5f66-43f7-9bba-b914ddf43d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:00.122387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324b30e-5f66-43f7-9bba-b914ddf43d82 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:00.131771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a214e-dc58-4670-9556-0f75bfe53c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:00.133031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a214e-dc58-4670-9556-0f75bfe53c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:00.133821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a214e-dc58-4670-9556-0f75bfe53c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:00.134298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a214e-dc58-4670-9556-0f75bfe53c7b admin admin] PATH_INFO: `/v3/projects/eb96250b24eb4423bdbc04cf9f8796ba/users/20eea9152a534080aa3f5e5e2d3f04bc/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:00.149533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 922/1830] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:00.161302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a214e-dc58-4670-9556-0f75bfe53c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb96250b24eb4423bdbc04cf9f8796ba, user_id=20eea9152a534080aa3f5e5e2d3f04bc, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:00.173535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a214e-dc58-4670-9556-0f75bfe53c7b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:00.207641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 909/1831] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:00 2022] PUT /identity/v3/projects/eb96250b24eb4423bdbc04cf9f8796ba/users/20eea9152a534080aa3f5e5e2d3f04bc/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:00.211392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324b30e-5f66-43f7-9bba-b914ddf43d82 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:00.227861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324b30e-5f66-43f7-9bba-b914ddf43d82 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:00.334288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7b6f3-2fc9-4673-afea-4dc194dc81f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:00.336602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7b6f3-2fc9-4673-afea-4dc194dc81f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:00.337130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7b6f3-2fc9-4673-afea-4dc194dc81f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:00.337418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7b6f3-2fc9-4673-afea-4dc194dc81f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:00.338548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7b6f3-2fc9-4673-afea-4dc194dc81f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:00.342581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7b6f3-2fc9-4673-afea-4dc194dc81f4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:00.368226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 923/1832] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:00.369107 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a214e-dc58-4670-9556-0f75bfe53c7b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:00.389281 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a214e-dc58-4670-9556-0f75bfe53c7b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:00.400791 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325e7d8-580d-42c3-8fdc-3b232d7bbf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:00.402014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325e7d8-580d-42c3-8fdc-3b232d7bbf70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:00.402298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325e7d8-580d-42c3-8fdc-3b232d7bbf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:00.402954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325e7d8-580d-42c3-8fdc-3b232d7bbf70 admin admin] PATH_INFO: `/v3/projects/eb96250b24eb4423bdbc04cf9f8796ba/users/20eea9152a534080aa3f5e5e2d3f04bc/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:00.406194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325e7d8-580d-42c3-8fdc-3b232d7bbf70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb96250b24eb4423bdbc04cf9f8796ba, user_id=20eea9152a534080aa3f5e5e2d3f04bc, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:00.413218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325e7d8-580d-42c3-8fdc-3b232d7bbf70 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:00.442494 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 910/1833] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:00 2022] PUT /identity/v3/projects/eb96250b24eb4423bdbc04cf9f8796ba/users/20eea9152a534080aa3f5e5e2d3f04bc/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:00.452349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a79551-98c0-421c-8500-1074329784b4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:00.452683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a79551-98c0-421c-8500-1074329784b4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:00.453058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a79551-98c0-421c-8500-1074329784b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:00.492362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-21a79551-98c0-421c-8500-1074329784b4 None None] MFA Rules not processed for user `20eea9152a534080aa3f5e5e2d3f04bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:00.493815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-21a79551-98c0-421c-8500-1074329784b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:00.614405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325e7d8-580d-42c3-8fdc-3b232d7bbf70 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:00.617473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d325e7d8-580d-42c3-8fdc-3b232d7bbf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:00.806233 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325e7d8-580d-42c3-8fdc-3b232d7bbf70 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:00.819648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 924/1834] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:00.824271 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:00.825665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:00.825665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:00.825888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] PATH_INFO: `/v3/projects/c6256decf3b547f8ae7bbf4208bf0d29` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:00.832685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6256decf3b547f8ae7bbf4208bf0d29)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:00.833473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a79551-98c0-421c-8500-1074329784b4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:00.834953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-21a79551-98c0-421c-8500-1074329784b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:00.836946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:00.938173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a79551-98c0-421c-8500-1074329784b4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:00.973018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:00.974816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6256decf3b547f8ae7bbf4208bf0d29', 'request_id': 'req-85396fa2-6d72-456d-8e95-3dcbc535823d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:00.983825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6256decf3b547f8ae7bbf4208bf0d29', 'request_id': 'req-85396fa2-6d72-456d-8e95-3dcbc535823d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:00.991874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6256decf3b547f8ae7bbf4208bf0d29', 'request_id': 'req-85396fa2-6d72-456d-8e95-3dcbc535823d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:01.016627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] The token cache is being invalidate because project c6256decf3b547f8ae7bbf4208bf0d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:01.016948 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:01.017711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-85396fa2-6d72-456d-8e95-3dcbc535823d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:01.036492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 911/1835] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:00 2022] DELETE /identity/v3/projects/c6256decf3b547f8ae7bbf4208bf0d29 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:01.042881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baa41c-24d9-4d8e-a33b-213131810204 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:01.043491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baa41c-24d9-4d8e-a33b-213131810204 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:01.043914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baa41c-24d9-4d8e-a33b-213131810204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:01.070859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3a8c7-298f-45d6-b926-c26ed277eb60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:01.072158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3a8c7-298f-45d6-b926-c26ed277eb60 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:01.072789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3a8c7-298f-45d6-b926-c26ed277eb60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:01.073248 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3a8c7-298f-45d6-b926-c26ed277eb60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:01.078424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8cc3a8c7-298f-45d6-b926-c26ed277eb60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:01.087531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e1baa41c-24d9-4d8e-a33b-213131810204 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:01.088794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e1baa41c-24d9-4d8e-a33b-213131810204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:01.156924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:01.184540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3a8c7-298f-45d6-b926-c26ed277eb60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:01.186055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3a8c7-298f-45d6-b926-c26ed277eb60 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:01.198744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 912/1836] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:01.208276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e389be5-1be4-4392-9368-b7170279c13e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:01.208714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e389be5-1be4-4392-9368-b7170279c13e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:01.209146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e389be5-1be4-4392-9368-b7170279c13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:01.230280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 925/1837] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:01.232299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3e389be5-1be4-4392-9368-b7170279c13e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:01.234014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3e389be5-1be4-4392-9368-b7170279c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:01.244865 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 913/1838] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:01.249102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3a8c7-298f-45d6-b926-c26ed277eb60 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:01.269976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3a8c7-298f-45d6-b926-c26ed277eb60 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:01.279202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96605c1-d203-4584-81ef-4f98184e38a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:01.281076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96605c1-d203-4584-81ef-4f98184e38a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:01.282112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96605c1-d203-4584-81ef-4f98184e38a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:01.282485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96605c1-d203-4584-81ef-4f98184e38a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:01.285134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96605c1-d203-4584-81ef-4f98184e38a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:01.285530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96605c1-d203-4584-81ef-4f98184e38a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:01.289460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96605c1-d203-4584-81ef-4f98184e38a8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:01.315189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 926/1839] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:01.321685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e389be5-1be4-4392-9368-b7170279c13e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:01.335627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e389be5-1be4-4392-9368-b7170279c13e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:01.354943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91b023-f558-4e5f-9567-e72cb83ef04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:01.355769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91b023-f558-4e5f-9567-e72cb83ef04e admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:01.356060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91b023-f558-4e5f-9567-e72cb83ef04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:01.356421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91b023-f558-4e5f-9567-e72cb83ef04e admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:01.357012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91b023-f558-4e5f-9567-e72cb83ef04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:01.359338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91b023-f558-4e5f-9567-e72cb83ef04e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:01.424747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 914/1840] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:01 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:01.430597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96605c1-d203-4584-81ef-4f98184e38a8 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:01.449214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96605c1-d203-4584-81ef-4f98184e38a8 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:01.586625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb11e7-466b-4128-b6c8-060d8d28412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:01.587992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb11e7-466b-4128-b6c8-060d8d28412b admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:01.590744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb11e7-466b-4128-b6c8-060d8d28412b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:01.591115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb11e7-466b-4128-b6c8-060d8d28412b admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:01.593140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb11e7-466b-4128-b6c8-060d8d28412b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:01.600173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb11e7-466b-4128-b6c8-060d8d28412b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:01.683798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91b023-f558-4e5f-9567-e72cb83ef04e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:01.696152 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 927/1841] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:01 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:01.719521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91b023-f558-4e5f-9567-e72cb83ef04e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:01.727499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b63bb-d352-4f01-b322-10667a337f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:01.728467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b63bb-d352-4f01-b322-10667a337f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:01.728944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b63bb-d352-4f01-b322-10667a337f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:01.729409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b63bb-d352-4f01-b322-10667a337f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:01.730396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b63bb-d352-4f01-b322-10667a337f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:01.732396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b63bb-d352-4f01-b322-10667a337f4e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:01.750057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 915/1842] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:01.756302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb11e7-466b-4128-b6c8-060d8d28412b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:01.778402 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb11e7-466b-4128-b6c8-060d8d28412b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:01.805942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f9569-66bb-4831-8d33-a7923d56d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:01.805942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f9569-66bb-4831-8d33-a7923d56d0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:01.805942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f9569-66bb-4831-8d33-a7923d56d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:01.810681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f9569-66bb-4831-8d33-a7923d56d0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:01.815031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f9569-66bb-4831-8d33-a7923d56d0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:01.819371 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f9569-66bb-4831-8d33-a7923d56d0f2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:01.851062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 928/1843] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:01.854899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b63bb-d352-4f01-b322-10667a337f4e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:01.873547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b63bb-d352-4f01-b322-10667a337f4e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:01.885139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935513e-6e0d-4035-b2ff-9092163248bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:01.886051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935513e-6e0d-4035-b2ff-9092163248bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:01.897309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935513e-6e0d-4035-b2ff-9092163248bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:01.897309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935513e-6e0d-4035-b2ff-9092163248bc admin admin] PATH_INFO: `/v3/projects/2211f5ebba89435eb7b2eaa0193ffb78/users/3fc273c3102147368e468b0e3384c5e7/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:01.929099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935513e-6e0d-4035-b2ff-9092163248bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2211f5ebba89435eb7b2eaa0193ffb78, user_id=3fc273c3102147368e468b0e3384c5e7, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:01.932004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935513e-6e0d-4035-b2ff-9092163248bc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:02.005192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 916/1844] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:01 2022] PUT /identity/v3/projects/2211f5ebba89435eb7b2eaa0193ffb78/users/3fc273c3102147368e468b0e3384c5e7/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:02.016705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8951-0c67-4f71-ab2b-7cbdfd00305b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:02.017192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8951-0c67-4f71-ab2b-7cbdfd00305b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:02.017379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8951-0c67-4f71-ab2b-7cbdfd00305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:02.056199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935513e-6e0d-4035-b2ff-9092163248bc admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:02.061834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0935513e-6e0d-4035-b2ff-9092163248bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:02.126891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-393d8951-0c67-4f71-ab2b-7cbdfd00305b None None] MFA Rules not processed for user `3fc273c3102147368e468b0e3384c5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:02.128792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-393d8951-0c67-4f71-ab2b-7cbdfd00305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:02.181920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:02.200678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935513e-6e0d-4035-b2ff-9092163248bc admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:02.216285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:02.217436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:02.218143 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:02.218509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] PATH_INFO: `/v3/projects/9b3675a3f04e47cc817271f19b3979ff` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:02.220744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3675a3f04e47cc817271f19b3979ff)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:02.231484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:02.290369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 929/1845] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:02.291566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8951-0c67-4f71-ab2b-7cbdfd00305b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:02.301392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-393d8951-0c67-4f71-ab2b-7cbdfd00305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:02.344559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8951-0c67-4f71-ab2b-7cbdfd00305b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:02.348148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3675a3f04e47cc817271f19b3979ff', 'request_id': 'req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:02.361844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3675a3f04e47cc817271f19b3979ff', 'request_id': 'req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:02.379446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3675a3f04e47cc817271f19b3979ff', 'request_id': 'req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:02.407016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] The token cache is being invalidate because project 9b3675a3f04e47cc817271f19b3979ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:02.407343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:02.408287 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:02.413173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 917/1846] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:02 2022] DELETE /identity/v3/projects/9b3675a3f04e47cc817271f19b3979ff => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:02.414089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:02.416108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:02.431372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:02.507451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:02.508152 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:02.508482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:02.508959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] PATH_INFO: `/v3/users/e7ad575e57ed46bf998e8855b9a2c451` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:02.511434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ad575e57ed46bf998e8855b9a2c451)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:02.522335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:02.558064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6983e03-2f60-4cb7-9d62-02f9af1fd22f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:02.571963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd4330-b17d-464e-ae24-b173b7abd74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:02.573326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd4330-b17d-464e-ae24-b173b7abd74b admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:02.574000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd4330-b17d-464e-ae24-b173b7abd74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:02.574960 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd4330-b17d-464e-ae24-b173b7abd74b admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:02.576233 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd4330-b17d-464e-ae24-b173b7abd74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:02.578514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd4330-b17d-464e-ae24-b173b7abd74b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:02.628075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ad575e57ed46bf998e8855b9a2c451'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:02.629079 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ad575e57ed46bf998e8855b9a2c451'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:02.670303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ad575e57ed46bf998e8855b9a2c451'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:02.687643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 918/1847] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:02 2022] POST /identity/v3/projects => generated 381 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:02.689329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd4330-b17d-464e-ae24-b173b7abd74b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:02.691622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bcfd4330-b17d-464e-ae24-b173b7abd74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:02.712059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ad575e57ed46bf998e8855b9a2c451'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:02.737031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ad575e57ed46bf998e8855b9a2c451'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:02.762481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 930/1848] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:02 2022] DELETE /identity/v3/users/e7ad575e57ed46bf998e8855b9a2c451 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:02.763200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:02.768112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:02.866493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:02.903211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd4330-b17d-464e-ae24-b173b7abd74b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:02.933006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a8e91-b672-4c39-b238-627fa8caaad6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:02.938666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e5c23-13aa-4003-bb1e-f11a6f85633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:02.939702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5c23-13aa-4003-bb1e-f11a6f85633c admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:02.940221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5c23-13aa-4003-bb1e-f11a6f85633c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:02.941319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5c23-13aa-4003-bb1e-f11a6f85633c admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:02.942241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e5c23-13aa-4003-bb1e-f11a6f85633c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:02.950510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e5c23-13aa-4003-bb1e-f11a6f85633c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:02.998139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 931/1849] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:02 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:03.013800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722ff6d-5d88-4ace-9b0a-e781994fbd46 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:03.014192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722ff6d-5d88-4ace-9b0a-e781994fbd46 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:03.014615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722ff6d-5d88-4ace-9b0a-e781994fbd46 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:03.017246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 932/1850] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:33:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:33:03.018077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052bc43-4699-4d1f-84e7-5c4f634ceca7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:03.018505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052bc43-4699-4d1f-84e7-5c4f634ceca7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:03.018911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052bc43-4699-4d1f-84e7-5c4f634ceca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:03.042826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:03.047555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:03.049568 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:03.050646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] PATH_INFO: `/v3/users/4723e65c378f42f48f8de1e66236e061` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:03.055083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4723e65c378f42f48f8de1e66236e061)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:03.060200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2052bc43-4699-4d1f-84e7-5c4f634ceca7 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:03.065322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2052bc43-4699-4d1f-84e7-5c4f634ceca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:03.074618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:03.098165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 933/1851] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:03.099306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052bc43-4699-4d1f-84e7-5c4f634ceca7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:03.129526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052bc43-4699-4d1f-84e7-5c4f634ceca7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:03.136160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc033d2-89c8-459a-869f-ac95b69a7df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:03.137154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc033d2-89c8-459a-869f-ac95b69a7df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:03.137833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc033d2-89c8-459a-869f-ac95b69a7df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:03.137833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc033d2-89c8-459a-869f-ac95b69a7df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:03.138759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc033d2-89c8-459a-869f-ac95b69a7df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:03.141351 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc033d2-89c8-459a-869f-ac95b69a7df6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:03.175621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 934/1852] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:03.175621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee59dae-6015-43d8-b82c-772c77868fd0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:03.175621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee59dae-6015-43d8-b82c-772c77868fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:03.176007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee59dae-6015-43d8-b82c-772c77868fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:03.192026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:03.202145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4723e65c378f42f48f8de1e66236e061'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:03.203606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4723e65c378f42f48f8de1e66236e061'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:03.204576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4723e65c378f42f48f8de1e66236e061'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:03.211337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-aee59dae-6015-43d8-b82c-772c77868fd0 None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:03.215279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-aee59dae-6015-43d8-b82c-772c77868fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:03.220050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4723e65c378f42f48f8de1e66236e061'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:03.230388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4723e65c378f42f48f8de1e66236e061'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:03.255320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 919/1853] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:02 2022] DELETE /identity/v3/users/4723e65c378f42f48f8de1e66236e061 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:03.256443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:03.258860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:03.346301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 935/1854] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:33:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:03.348731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028b850-d7b4-464d-baea-927ffbce6539 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:03.353443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7fc7d-3f7e-445f-a6f9-376a53972037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:03.354342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7fc7d-3f7e-445f-a6f9-376a53972037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:03.354947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7fc7d-3f7e-445f-a6f9-376a53972037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:03.355237 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7fc7d-3f7e-445f-a6f9-376a53972037 admin admin] PATH_INFO: `/v3/projects/061787b648cd4467b9148243bed40b8b/users/8d2d00b82bf447309fbf24e8ec6ac90d/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:03.356879 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee59dae-6015-43d8-b82c-772c77868fd0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:03.361052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-aee59dae-6015-43d8-b82c-772c77868fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:03.375744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7fc7d-3f7e-445f-a6f9-376a53972037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061787b648cd4467b9148243bed40b8b, user_id=8d2d00b82bf447309fbf24e8ec6ac90d, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:03.380572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7fc7d-3f7e-445f-a6f9-376a53972037 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:03.407428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 920/1855] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:03 2022] PUT /identity/v3/projects/061787b648cd4467b9148243bed40b8b/users/8d2d00b82bf447309fbf24e8ec6ac90d/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:03.411144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7fc7d-3f7e-445f-a6f9-376a53972037 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:03.551220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee59dae-6015-43d8-b82c-772c77868fd0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:03.627832 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7fc7d-3f7e-445f-a6f9-376a53972037 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:03.638674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fb3a1-0ac2-4438-a996-2ee0c73def05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:03.640464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb3a1-0ac2-4438-a996-2ee0c73def05 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:03.640823 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb3a1-0ac2-4438-a996-2ee0c73def05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:03.641171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb3a1-0ac2-4438-a996-2ee0c73def05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:03.654129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fb3a1-0ac2-4438-a996-2ee0c73def05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:03.658591 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fb3a1-0ac2-4438-a996-2ee0c73def05 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:03.683550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 921/1856] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:03.683741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afad9d-9dee-4d31-bc6f-81ce1f3e3e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:03.684548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afad9d-9dee-4d31-bc6f-81ce1f3e3e3a service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:03.684839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afad9d-9dee-4d31-bc6f-81ce1f3e3e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:03.685166 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afad9d-9dee-4d31-bc6f-81ce1f3e3e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:03.687547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d1afad9d-9dee-4d31-bc6f-81ce1f3e3e3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:03.695953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fb3a1-0ac2-4438-a996-2ee0c73def05 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:03.720366 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fb3a1-0ac2-4438-a996-2ee0c73def05 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:03.721368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afad9d-9dee-4d31-bc6f-81ce1f3e3e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:03.723614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afad9d-9dee-4d31-bc6f-81ce1f3e3e3a service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:03.727724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e067d6-f6c5-4e99-9ab9-748013b2e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:03.728983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e067d6-f6c5-4e99-9ab9-748013b2e733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:03.729440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e067d6-f6c5-4e99-9ab9-748013b2e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:03.729723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e067d6-f6c5-4e99-9ab9-748013b2e733 admin admin] PATH_INFO: `/v3/projects/061787b648cd4467b9148243bed40b8b/users/8d2d00b82bf447309fbf24e8ec6ac90d/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:03.732289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e067d6-f6c5-4e99-9ab9-748013b2e733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061787b648cd4467b9148243bed40b8b, user_id=8d2d00b82bf447309fbf24e8ec6ac90d, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:03.735893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e067d6-f6c5-4e99-9ab9-748013b2e733 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:03.753804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 936/1857] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:03.755820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 922/1858] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:03 2022] PUT /identity/v3/projects/061787b648cd4467b9148243bed40b8b/users/8d2d00b82bf447309fbf24e8ec6ac90d/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:03.767309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24a99-b658-4d70-a6d4-6fdcdfd74a58 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:03.767652 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24a99-b658-4d70-a6d4-6fdcdfd74a58 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:03.767932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24a99-b658-4d70-a6d4-6fdcdfd74a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:03.774013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:03.823502 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-fbc24a99-b658-4d70-a6d4-6fdcdfd74a58 None None] MFA Rules not processed for user `8d2d00b82bf447309fbf24e8ec6ac90d`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:03.824002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fbc24a99-b658-4d70-a6d4-6fdcdfd74a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:03.926686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e067d6-f6c5-4e99-9ab9-748013b2e733 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:03.929305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-17e067d6-f6c5-4e99-9ab9-748013b2e733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:03.949504 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 937/1859] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:03.968497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc24a99-b658-4d70-a6d4-6fdcdfd74a58 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:03.970151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-fbc24a99-b658-4d70-a6d4-6fdcdfd74a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:03.982799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:04.052024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e067d6-f6c5-4e99-9ab9-748013b2e733 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:04.058730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ff9a2-035c-4ca0-b014-de6cafb16dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:04.059699 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ff9a2-035c-4ca0-b014-de6cafb16dc6 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:04.059987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ff9a2-035c-4ca0-b014-de6cafb16dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:04.060260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ff9a2-035c-4ca0-b014-de6cafb16dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:04.074916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ff9a2-035c-4ca0-b014-de6cafb16dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:04.076604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ff9a2-035c-4ca0-b014-de6cafb16dc6 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:04.091368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 923/1860] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:04.141432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc24a99-b658-4d70-a6d4-6fdcdfd74a58 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:04.155588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ab5c2-d5e1-4dbe-9a87-c84ee4f90504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:04.156261 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab5c2-d5e1-4dbe-9a87-c84ee4f90504 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:04.156792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab5c2-d5e1-4dbe-9a87-c84ee4f90504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:04.157078 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab5c2-d5e1-4dbe-9a87-c84ee4f90504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:04.187234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ab5c2-d5e1-4dbe-9a87-c84ee4f90504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:04.189600 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ab5c2-d5e1-4dbe-9a87-c84ee4f90504 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:04.223021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 938/1861] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:04.363113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1436-88b7-4c95-90eb-b6b126202100 None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:04.363402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1436-88b7-4c95-90eb-b6b126202100 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:04.363681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1436-88b7-4c95-90eb-b6b126202100 None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:04.365328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 924/1862] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:33:04.377290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1bde8-7537-4a3e-9730-1c91b819e8d4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:04.377574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1bde8-7537-4a3e-9730-1c91b819e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:04.378179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1bde8-7537-4a3e-9730-1c91b819e8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:04.434835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-88e1bde8-7537-4a3e-9730-1c91b819e8d4 None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:04.438398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-88e1bde8-7537-4a3e-9730-1c91b819e8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:04.452904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 939/1863] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:33:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:04.476619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1436-88b7-4c95-90eb-b6b126202100 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:04.479298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4bfa1436-88b7-4c95-90eb-b6b126202100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:04.505805 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1436-88b7-4c95-90eb-b6b126202100 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:04.514080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c31cde-c418-4688-9671-d7fd13687bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:04.514868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31cde-c418-4688-9671-d7fd13687bc1 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:04.515248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31cde-c418-4688-9671-d7fd13687bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:04.515534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31cde-c418-4688-9671-d7fd13687bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:04.534327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c31cde-c418-4688-9671-d7fd13687bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:04.537607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c31cde-c418-4688-9671-d7fd13687bc1 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:04.580695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 925/1864] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:04.868727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1bde8-7537-4a3e-9730-1c91b819e8d4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:04.869674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-88e1bde8-7537-4a3e-9730-1c91b819e8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:04.899694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c31cde-c418-4688-9671-d7fd13687bc1 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:05.001994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1bde8-7537-4a3e-9730-1c91b819e8d4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:05.008474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:05.018409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:05.018409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:05.018409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] PATH_INFO: `/v3/projects/9c0450a647ad46eea1fd6f5291b30d81` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:05.018409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0450a647ad46eea1fd6f5291b30d81)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:05.018409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:05.025115 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c31cde-c418-4688-9671-d7fd13687bc1 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:05.031648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:05.032539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:05.033309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:05.033309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] PATH_INFO: `/v3/users/3fc273c3102147368e468b0e3384c5e7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:05.040171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc273c3102147368e468b0e3384c5e7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:05.042138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:05.070262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:05.117004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0450a647ad46eea1fd6f5291b30d81', 'request_id': 'req-99579496-c27e-4afe-8b49-ab062f03d45e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.132139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0450a647ad46eea1fd6f5291b30d81', 'request_id': 'req-99579496-c27e-4afe-8b49-ab062f03d45e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.152595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0450a647ad46eea1fd6f5291b30d81', 'request_id': 'req-99579496-c27e-4afe-8b49-ab062f03d45e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.156175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc273c3102147368e468b0e3384c5e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.158666 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc273c3102147368e468b0e3384c5e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.165195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc273c3102147368e468b0e3384c5e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.173192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] The token cache is being invalidate because project 9c0450a647ad46eea1fd6f5291b30d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:05.173582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.174314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-99579496-c27e-4afe-8b49-ab062f03d45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.178867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 940/1865] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:04 2022] DELETE /identity/v3/projects/9c0450a647ad46eea1fd6f5291b30d81 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:05.183459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcfef5-aebe-4279-ba89-0ee8fdc5c374 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:05.183627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcfef5-aebe-4279-ba89-0ee8fdc5c374 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:05.183908 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcfef5-aebe-4279-ba89-0ee8fdc5c374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:05.217012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc273c3102147368e468b0e3384c5e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.232717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc273c3102147368e468b0e3384c5e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.236678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ebdcfef5-aebe-4279-ba89-0ee8fdc5c374 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:05.239389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ebdcfef5-aebe-4279-ba89-0ee8fdc5c374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:05.271926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 926/1866] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:04 2022] DELETE /identity/v3/users/3fc273c3102147368e468b0e3384c5e7 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:05.275722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:05.287479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:05.317336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:05.321522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 941/1867] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:05.323453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bce5-1ccd-4f7d-b46f-67ef31fb64c9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:05.324029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bce5-1ccd-4f7d-b46f-67ef31fb64c9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:05.324448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bce5-1ccd-4f7d-b46f-67ef31fb64c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:05.365414 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1de8bce5-1ccd-4f7d-b46f-67ef31fb64c9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:05.366674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1de8bce5-1ccd-4f7d-b46f-67ef31fb64c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:05.385723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de0a49-7cc2-4a76-be7e-6ee840dfc55e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:05.391927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:05.393004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:05.393410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:05.393968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] PATH_INFO: `/v3/projects/b5d334bc0baa4664ac32c2e472934ad6` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:05.395535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d334bc0baa4664ac32c2e472934ad6)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:05.399331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:05.451913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 942/1868] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:05.464822 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16b343-5c61-45ef-bdab-29bd288ae541 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:05.465179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16b343-5c61-45ef-bdab-29bd288ae541 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:05.465604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16b343-5c61-45ef-bdab-29bd288ae541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:05.505823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ac16b343-5c61-45ef-bdab-29bd288ae541 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:05.512177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d334bc0baa4664ac32c2e472934ad6', 'request_id': 'req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.518382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ac16b343-5c61-45ef-bdab-29bd288ae541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:05.532443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d334bc0baa4664ac32c2e472934ad6', 'request_id': 'req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.542467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d334bc0baa4664ac32c2e472934ad6', 'request_id': 'req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.571581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] The token cache is being invalidate because project b5d334bc0baa4664ac32c2e472934ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:05.572049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.573105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.576135 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 927/1869] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:05 2022] DELETE /identity/v3/projects/b5d334bc0baa4664ac32c2e472934ad6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:05.577372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:05.581926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:05.600259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:05.620573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 943/1870] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:05.621304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16b343-5c61-45ef-bdab-29bd288ae541 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:05.622735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ac16b343-5c61-45ef-bdab-29bd288ae541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:05.636900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16b343-5c61-45ef-bdab-29bd288ae541 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:05.647184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:05.648112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:05.648399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:05.648678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] PATH_INFO: `/v3/users/20eea9152a534080aa3f5e5e2d3f04bc` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:05.650074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20eea9152a534080aa3f5e5e2d3f04bc)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:05.652153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:05.673817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1585a-7c2b-4a98-ab25-c62b1fb99340 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:05.678126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07697b79-85a4-46ac-98be-2c97aeaa9bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:05.679031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07697b79-85a4-46ac-98be-2c97aeaa9bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:05.679368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07697b79-85a4-46ac-98be-2c97aeaa9bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:05.679815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07697b79-85a4-46ac-98be-2c97aeaa9bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:05.681948 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-07697b79-85a4-46ac-98be-2c97aeaa9bd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:05.698164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07697b79-85a4-46ac-98be-2c97aeaa9bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:05.699978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07697b79-85a4-46ac-98be-2c97aeaa9bd2 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:05.712882 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 928/1871] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:05.713927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07697b79-85a4-46ac-98be-2c97aeaa9bd2 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:05.725588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07697b79-85a4-46ac-98be-2c97aeaa9bd2 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:05.727296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20eea9152a534080aa3f5e5e2d3f04bc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.728075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20eea9152a534080aa3f5e5e2d3f04bc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.734283 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0ab81-2b1e-4cfa-a0e9-adb0ee76d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:05.735133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0ab81-2b1e-4cfa-a0e9-adb0ee76d45c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:05.735481 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0ab81-2b1e-4cfa-a0e9-adb0ee76d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:05.736158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0ab81-2b1e-4cfa-a0e9-adb0ee76d45c admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:05.736893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0ab81-2b1e-4cfa-a0e9-adb0ee76d45c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:05.739899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0ab81-2b1e-4cfa-a0e9-adb0ee76d45c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:05.740058 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0ab81-2b1e-4cfa-a0e9-adb0ee76d45c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:05.753763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20eea9152a534080aa3f5e5e2d3f04bc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.757970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 929/1872] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:05.759535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0ab81-2b1e-4cfa-a0e9-adb0ee76d45c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:05.771322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0ab81-2b1e-4cfa-a0e9-adb0ee76d45c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:05.774218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20eea9152a534080aa3f5e5e2d3f04bc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.776067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bb69a-94de-4e88-83d8-20867ce53a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:05.776723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bb69a-94de-4e88-83d8-20867ce53a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:05.777007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bb69a-94de-4e88-83d8-20867ce53a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:05.777630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bb69a-94de-4e88-83d8-20867ce53a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:05.777981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bb69a-94de-4e88-83d8-20867ce53a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:05.780507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bb69a-94de-4e88-83d8-20867ce53a61 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:05.786332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20eea9152a534080aa3f5e5e2d3f04bc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:05.796298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 944/1873] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:05 2022] DELETE /identity/v3/users/20eea9152a534080aa3f5e5e2d3f04bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:05.822398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 930/1874] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:05 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:05.825501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:05.827065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:05.912382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385a0de-cb27-49e7-8190-8123bdb93357 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:05.999307 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786f1a-32c0-4ba1-bc74-ba1051c3baff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:06.000463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786f1a-32c0-4ba1-bc74-ba1051c3baff admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.000748 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786f1a-32c0-4ba1-bc74-ba1051c3baff admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.001120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786f1a-32c0-4ba1-bc74-ba1051c3baff admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.001825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786f1a-32c0-4ba1-bc74-ba1051c3baff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:06.004712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786f1a-32c0-4ba1-bc74-ba1051c3baff admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:06.033900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 945/1875] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:05 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:06.034770 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bb69a-94de-4e88-83d8-20867ce53a61 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:06.051674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bb69a-94de-4e88-83d8-20867ce53a61 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:06.066882 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b782f3b-8aee-4bf7-a039-b7da7db2f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:06.067564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782f3b-8aee-4bf7-a039-b7da7db2f882 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.067847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782f3b-8aee-4bf7-a039-b7da7db2f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.068125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782f3b-8aee-4bf7-a039-b7da7db2f882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.068866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b782f3b-8aee-4bf7-a039-b7da7db2f882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:06.070550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b782f3b-8aee-4bf7-a039-b7da7db2f882 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:06.076543 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:06.099224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 931/1876] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:06.101025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786f1a-32c0-4ba1-bc74-ba1051c3baff admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:06.112431 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:06.120834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786f1a-32c0-4ba1-bc74-ba1051c3baff admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:06.129350 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f53119-806a-4d06-815b-b73f5b1af79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:06.133049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f53119-806a-4d06-815b-b73f5b1af79f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.133049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f53119-806a-4d06-815b-b73f5b1af79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.133049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f53119-806a-4d06-815b-b73f5b1af79f admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.134536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f53119-806a-4d06-815b-b73f5b1af79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:06.136758 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f53119-806a-4d06-815b-b73f5b1af79f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:06.153034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b782f3b-8aee-4bf7-a039-b7da7db2f882 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:06.157546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 946/1877] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:06.158657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5b782f3b-8aee-4bf7-a039-b7da7db2f882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:06.160820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f53119-806a-4d06-815b-b73f5b1af79f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:06.180958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b782f3b-8aee-4bf7-a039-b7da7db2f882 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:06.193018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:06.193906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.194289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.194556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] PATH_INFO: `/v3/projects/eb96250b24eb4423bdbc04cf9f8796ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.195886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb96250b24eb4423bdbc04cf9f8796ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:06.199301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f53119-806a-4d06-815b-b73f5b1af79f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:06.200052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:06.213384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd6130-2492-48ec-bb71-309861638f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:06.214387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd6130-2492-48ec-bb71-309861638f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.214684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd6130-2492-48ec-bb71-309861638f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.214960 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd6130-2492-48ec-bb71-309861638f34 admin admin] PATH_INFO: `/v3/projects/b63e9a592cce426a911c8fd03474049c/users/14aa838cc2c84308951dfe8da868b589/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.231292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd6130-2492-48ec-bb71-309861638f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63e9a592cce426a911c8fd03474049c, user_id=14aa838cc2c84308951dfe8da868b589, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:06.234316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd6130-2492-48ec-bb71-309861638f34 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:06.258734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 947/1878] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:06 2022] PUT /identity/v3/projects/b63e9a592cce426a911c8fd03474049c/users/14aa838cc2c84308951dfe8da868b589/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:06.262595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd6130-2492-48ec-bb71-309861638f34 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:06.275794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-75cd6130-2492-48ec-bb71-309861638f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:06.283250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb96250b24eb4423bdbc04cf9f8796ba', 'request_id': 'req-2ab72202-72b6-4712-bcff-f2642bd71cc4'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.293774 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb96250b24eb4423bdbc04cf9f8796ba', 'request_id': 'req-2ab72202-72b6-4712-bcff-f2642bd71cc4'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.302903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb96250b24eb4423bdbc04cf9f8796ba', 'request_id': 'req-2ab72202-72b6-4712-bcff-f2642bd71cc4'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.319503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] The token cache is being invalidate because project eb96250b24eb4423bdbc04cf9f8796ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:06.319793 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.320462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2ab72202-72b6-4712-bcff-f2642bd71cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.322063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 932/1879] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:06 2022] DELETE /identity/v3/projects/eb96250b24eb4423bdbc04cf9f8796ba => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:06.326886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518a3e-22a2-41fc-9c36-f1063e9197e6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.327176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518a3e-22a2-41fc-9c36-f1063e9197e6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.327459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518a3e-22a2-41fc-9c36-f1063e9197e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.355837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-16518a3e-22a2-41fc-9c36-f1063e9197e6 None None] MFA Rules not processed for user `14aa838cc2c84308951dfe8da868b589`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:06.357189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-16518a3e-22a2-41fc-9c36-f1063e9197e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:06.365862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd6130-2492-48ec-bb71-309861638f34 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:06.428474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:06.429385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.429674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.429942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] PATH_INFO: `/v3/projects/2211f5ebba89435eb7b2eaa0193ffb78` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.431417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2211f5ebba89435eb7b2eaa0193ffb78)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:06.433347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:06.442267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 933/1880] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:06.443576 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12799523-8a55-4670-8fad-cca1998e4e2a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.443868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12799523-8a55-4670-8fad-cca1998e4e2a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.444163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12799523-8a55-4670-8fad-cca1998e4e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.468033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-12799523-8a55-4670-8fad-cca1998e4e2a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:06.469257 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-12799523-8a55-4670-8fad-cca1998e4e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:06.477414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 934/1881] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:06.478238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12799523-8a55-4670-8fad-cca1998e4e2a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:06.479610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-12799523-8a55-4670-8fad-cca1998e4e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:06.502343 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2211f5ebba89435eb7b2eaa0193ffb78', 'request_id': 'req-360a6185-007b-417c-8bca-e12f9433f48e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.511790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2211f5ebba89435eb7b2eaa0193ffb78', 'request_id': 'req-360a6185-007b-417c-8bca-e12f9433f48e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.517618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2211f5ebba89435eb7b2eaa0193ffb78', 'request_id': 'req-360a6185-007b-417c-8bca-e12f9433f48e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.529086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] The token cache is being invalidate because project 2211f5ebba89435eb7b2eaa0193ffb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:06.529306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.529904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-360a6185-007b-417c-8bca-e12f9433f48e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.531499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 948/1882] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:06 2022] DELETE /identity/v3/projects/2211f5ebba89435eb7b2eaa0193ffb78 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:06.532718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875638-adce-465e-b74b-e3c564e32ae6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.533000 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875638-adce-465e-b74b-e3c564e32ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.533272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875638-adce-465e-b74b-e3c564e32ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.538665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12799523-8a55-4670-8fad-cca1998e4e2a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:06.545470 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:06.552657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f0875638-adce-465e-b74b-e3c564e32ae6 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:06.554456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f0875638-adce-465e-b74b-e3c564e32ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:06.558977 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:06.595010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683c507-fd62-4959-8ca8-7764d0384073 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe27c3402a741f0a80d87ae6ecd3f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:06.595660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683c507-fd62-4959-8ca8-7764d0384073 service glance] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.595943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683c507-fd62-4959-8ca8-7764d0384073 service glance] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.596215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683c507-fd62-4959-8ca8-7764d0384073 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.598054 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8683c507-fd62-4959-8ca8-7764d0384073 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:06.621777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 949/1883] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:06.622616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875638-adce-465e-b74b-e3c564e32ae6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:06.623942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f0875638-adce-465e-b74b-e3c564e32ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:06.636111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875638-adce-465e-b74b-e3c564e32ae6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:06.641678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:06.642572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.642856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.643134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] PATH_INFO: `/v3/users/8d2d00b82bf447309fbf24e8ec6ac90d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.645487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2d00b82bf447309fbf24e8ec6ac90d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:06.646864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:06.660239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683c507-fd62-4959-8ca8-7764d0384073 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:06.661992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683c507-fd62-4959-8ca8-7764d0384073 service glance] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:06.671317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 935/1884] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:06.672139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683c507-fd62-4959-8ca8-7764d0384073 service glance] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:06.686743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683c507-fd62-4959-8ca8-7764d0384073 service glance] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:06.693655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf327af-0573-468d-99a6-244f32a026c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:06.694845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf327af-0573-468d-99a6-244f32a026c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.695345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf327af-0573-468d-99a6-244f32a026c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.695817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf327af-0573-468d-99a6-244f32a026c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.696971 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf327af-0573-468d-99a6-244f32a026c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:06.697719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf327af-0573-468d-99a6-244f32a026c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:06.699864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf327af-0573-468d-99a6-244f32a026c5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:06.718063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 936/1885] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:06.719102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2d00b82bf447309fbf24e8ec6ac90d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.720732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2d00b82bf447309fbf24e8ec6ac90d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.721613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf327af-0573-468d-99a6-244f32a026c5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:06.731531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2d00b82bf447309fbf24e8ec6ac90d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.751170 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2d00b82bf447309fbf24e8ec6ac90d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.752547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf327af-0573-468d-99a6-244f32a026c5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:06.767740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2d00b82bf447309fbf24e8ec6ac90d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:06.778389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 950/1886] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:06 2022] DELETE /identity/v3/users/8d2d00b82bf447309fbf24e8ec6ac90d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:06.784607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd266e68-fe53-47f3-a334-0ec71dd2752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:06.785204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd266e68-fe53-47f3-a334-0ec71dd2752c admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:06.785489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd266e68-fe53-47f3-a334-0ec71dd2752c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:06.785765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd266e68-fe53-47f3-a334-0ec71dd2752c admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:06.786510 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd266e68-fe53-47f3-a334-0ec71dd2752c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:06.788426 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd266e68-fe53-47f3-a334-0ec71dd2752c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:06.853529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 937/1887] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:06 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:06.855019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:06.856599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:06.980521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a4611-7d19-4eb3-96a9-ff9b10ded09f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:07.015955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:07.073602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322862de-b188-4173-a4df-32984cf20980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:07.074885 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322862de-b188-4173-a4df-32984cf20980 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:07.075292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322862de-b188-4173-a4df-32984cf20980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:07.075659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322862de-b188-4173-a4df-32984cf20980 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:07.076895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322862de-b188-4173-a4df-32984cf20980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:07.079057 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322862de-b188-4173-a4df-32984cf20980 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:07.109994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 951/1888] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:06 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:07.112125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd266e68-fe53-47f3-a334-0ec71dd2752c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:07.130625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd266e68-fe53-47f3-a334-0ec71dd2752c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:07.137152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769811e2-fd44-4454-98e0-ef65ef496482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:07.138030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769811e2-fd44-4454-98e0-ef65ef496482 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:07.138407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769811e2-fd44-4454-98e0-ef65ef496482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:07.138784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769811e2-fd44-4454-98e0-ef65ef496482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:07.140397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769811e2-fd44-4454-98e0-ef65ef496482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:07.142970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769811e2-fd44-4454-98e0-ef65ef496482 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:07.159516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 938/1889] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:07.163745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322862de-b188-4173-a4df-32984cf20980 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:07.177126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322862de-b188-4173-a4df-32984cf20980 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:07.188531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8bad-79ab-4ddb-bc06-98a5a881f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:07.189215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8bad-79ab-4ddb-bc06-98a5a881f58d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:07.189501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8bad-79ab-4ddb-bc06-98a5a881f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:07.189781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8bad-79ab-4ddb-bc06-98a5a881f58d admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:07.191332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d8bad-79ab-4ddb-bc06-98a5a881f58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:07.193162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d8bad-79ab-4ddb-bc06-98a5a881f58d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:07.206684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 952/1890] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:07.210551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769811e2-fd44-4454-98e0-ef65ef496482 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:07.223827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769811e2-fd44-4454-98e0-ef65ef496482 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:07.229849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfa691-8111-42f9-9a5f-85b7ab18cb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:07.230893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfa691-8111-42f9-9a5f-85b7ab18cb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:07.231522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfa691-8111-42f9-9a5f-85b7ab18cb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:07.231522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfa691-8111-42f9-9a5f-85b7ab18cb12 admin admin] PATH_INFO: `/v3/projects/22d27e58538f4e21b06a404a77398165/users/10d099637a2c490ea98ff18b6472e603/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:07.250794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfa691-8111-42f9-9a5f-85b7ab18cb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d27e58538f4e21b06a404a77398165, user_id=10d099637a2c490ea98ff18b6472e603, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:07.259819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfa691-8111-42f9-9a5f-85b7ab18cb12 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:07.286069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 939/1891] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:07 2022] PUT /identity/v3/projects/22d27e58538f4e21b06a404a77398165/users/10d099637a2c490ea98ff18b6472e603/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:07.289456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b198-2598-4b48-947e-88ebe273ee10 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:07.289764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b198-2598-4b48-947e-88ebe273ee10 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:07.290074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b198-2598-4b48-947e-88ebe273ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:07.371234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-96d1b198-2598-4b48-947e-88ebe273ee10 None None] MFA Rules not processed for user `10d099637a2c490ea98ff18b6472e603`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:07.376515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-96d1b198-2598-4b48-947e-88ebe273ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:07.518408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 953/1892] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:07.520879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfa691-8111-42f9-9a5f-85b7ab18cb12 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:07.598269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfa691-8111-42f9-9a5f-85b7ab18cb12 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:07.603529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd1c29-f13e-4e1b-b67c-8277bf79f9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:07.605087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd1c29-f13e-4e1b-b67c-8277bf79f9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:07.605429 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd1c29-f13e-4e1b-b67c-8277bf79f9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:07.605637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd1c29-f13e-4e1b-b67c-8277bf79f9a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:07.606342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd1c29-f13e-4e1b-b67c-8277bf79f9a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:07.609145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd1c29-f13e-4e1b-b67c-8277bf79f9a6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:07.644534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:07.681389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1b198-2598-4b48-947e-88ebe273ee10 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:07.683612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 940/1893] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:07 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:07.699235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1b198-2598-4b48-947e-88ebe273ee10 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:07.805092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede914ca-3101-45c2-b706-15cd36f20a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:07.805788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede914ca-3101-45c2-b706-15cd36f20a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:07.807154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede914ca-3101-45c2-b706-15cd36f20a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:07.807154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede914ca-3101-45c2-b706-15cd36f20a33 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:07.807154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede914ca-3101-45c2-b706-15cd36f20a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:07.809322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede914ca-3101-45c2-b706-15cd36f20a33 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:07.856435 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 954/1894] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:07 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:33:07.860092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd1c29-f13e-4e1b-b67c-8277bf79f9a6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:07.875307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd1c29-f13e-4e1b-b67c-8277bf79f9a6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:07.881319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6a301-c4a8-4db0-a974-d4d53ef8f3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:07.881996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6a301-c4a8-4db0-a974-d4d53ef8f3ef admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:07.882332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6a301-c4a8-4db0-a974-d4d53ef8f3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:07.882862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6a301-c4a8-4db0-a974-d4d53ef8f3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:07.883442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6a301-c4a8-4db0-a974-d4d53ef8f3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:07.885473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6a301-c4a8-4db0-a974-d4d53ef8f3ef admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:07.898391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 941/1895] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:07.901994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede914ca-3101-45c2-b706-15cd36f20a33 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:07.914930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede914ca-3101-45c2-b706-15cd36f20a33 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:07.927901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64bd66-efe5-48fa-9b64-8fdaf574b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:07.928336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64bd66-efe5-48fa-9b64-8fdaf574b1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:07.928575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64bd66-efe5-48fa-9b64-8fdaf574b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:07.928766 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64bd66-efe5-48fa-9b64-8fdaf574b1c0 admin admin] PATH_INFO: `/v3/projects/c54dd9f89eed4393bf3c1b4170e0b021/users/d09d4f10e014447b9d2b241035e32ef2/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:07.952428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64bd66-efe5-48fa-9b64-8fdaf574b1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54dd9f89eed4393bf3c1b4170e0b021, user_id=d09d4f10e014447b9d2b241035e32ef2, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:07.955958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64bd66-efe5-48fa-9b64-8fdaf574b1c0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:07.974796 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:07.987066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 955/1896] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:07 2022] PUT /identity/v3/projects/c54dd9f89eed4393bf3c1b4170e0b021/users/d09d4f10e014447b9d2b241035e32ef2/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:07.991230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6a301-c4a8-4db0-a974-d4d53ef8f3ef admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:08.009208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6a301-c4a8-4db0-a974-d4d53ef8f3ef admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:08.127340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63fa0c-9820-4096-a4fc-ec70c01c7731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:08.128091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63fa0c-9820-4096-a4fc-ec70c01c7731 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:08.128362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63fa0c-9820-4096-a4fc-ec70c01c7731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:08.128643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63fa0c-9820-4096-a4fc-ec70c01c7731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:08.129385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63fa0c-9820-4096-a4fc-ec70c01c7731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:08.131047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63fa0c-9820-4096-a4fc-ec70c01c7731 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:08.178905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 942/1897] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:08.184598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64bd66-efe5-48fa-9b64-8fdaf574b1c0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:08.202428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64bd66-efe5-48fa-9b64-8fdaf574b1c0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:08.223156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73129859-35ee-4a69-a9f2-f1775c1b66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:08.224223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129859-35ee-4a69-a9f2-f1775c1b66ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:08.224682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129859-35ee-4a69-a9f2-f1775c1b66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:08.225340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129859-35ee-4a69-a9f2-f1775c1b66ff admin admin] PATH_INFO: `/v3/projects/c54dd9f89eed4393bf3c1b4170e0b021/users/d09d4f10e014447b9d2b241035e32ef2/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:08.228009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73129859-35ee-4a69-a9f2-f1775c1b66ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54dd9f89eed4393bf3c1b4170e0b021, user_id=d09d4f10e014447b9d2b241035e32ef2, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:08.231287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73129859-35ee-4a69-a9f2-f1775c1b66ff admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:08.263012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 956/1898] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:08 2022] PUT /identity/v3/projects/c54dd9f89eed4393bf3c1b4170e0b021/users/d09d4f10e014447b9d2b241035e32ef2/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:08.269595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eadc4c-077f-4b99-920f-8e1642e12097 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:08.269895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eadc4c-077f-4b99-920f-8e1642e12097 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:08.270174 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eadc4c-077f-4b99-920f-8e1642e12097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:08.324240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-89eadc4c-077f-4b99-920f-8e1642e12097 None None] MFA Rules not processed for user `d09d4f10e014447b9d2b241035e32ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:08.326073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-89eadc4c-077f-4b99-920f-8e1642e12097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:08.428996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 943/1899] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:08.442306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73129859-35ee-4a69-a9f2-f1775c1b66ff admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:08.444305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-73129859-35ee-4a69-a9f2-f1775c1b66ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:08.526828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73129859-35ee-4a69-a9f2-f1775c1b66ff admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:08.537068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533ef64-bd26-4b61-8613-ecf29ec6f14c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:08.538012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533ef64-bd26-4b61-8613-ecf29ec6f14c service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:08.538418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533ef64-bd26-4b61-8613-ecf29ec6f14c service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:08.538779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533ef64-bd26-4b61-8613-ecf29ec6f14c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:08.551527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533ef64-bd26-4b61-8613-ecf29ec6f14c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:08.553682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533ef64-bd26-4b61-8613-ecf29ec6f14c service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:08.564308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 957/1900] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:08.594842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eadc4c-077f-4b99-920f-8e1642e12097 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:08.702584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eadc4c-077f-4b99-920f-8e1642e12097 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:08.709382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:08.710568 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:08.711062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:08.711436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] PATH_INFO: `/v3/users/10d099637a2c490ea98ff18b6472e603` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:08.711732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533ef64-bd26-4b61-8613-ecf29ec6f14c service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:08.712870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d099637a2c490ea98ff18b6472e603)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:08.713190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6533ef64-bd26-4b61-8613-ecf29ec6f14c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:08.715605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:08.718590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:08.734209 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533ef64-bd26-4b61-8613-ecf29ec6f14c service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:08.742115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:08.743644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:08.743644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:08.743644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] PATH_INFO: `/v3/projects/061787b648cd4467b9148243bed40b8b` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:08.744779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=061787b648cd4467b9148243bed40b8b)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:08.746997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:08.829439 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d099637a2c490ea98ff18b6472e603'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:08.831750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d099637a2c490ea98ff18b6472e603'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:08.833397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d099637a2c490ea98ff18b6472e603'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:08.837752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061787b648cd4467b9148243bed40b8b', 'request_id': 'req-c214f4ea-ce2a-4448-9670-7c262b039f94'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:08.859647 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d099637a2c490ea98ff18b6472e603'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:08.875198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061787b648cd4467b9148243bed40b8b', 'request_id': 'req-c214f4ea-ce2a-4448-9670-7c262b039f94'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:08.883973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061787b648cd4467b9148243bed40b8b', 'request_id': 'req-c214f4ea-ce2a-4448-9670-7c262b039f94'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:08.890635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fd1b45f3-c5cb-43eb-b72d-cdd239a8393c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d099637a2c490ea98ff18b6472e603'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:08.911009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 944/1901] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:08 2022] DELETE /identity/v3/users/10d099637a2c490ea98ff18b6472e603 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:08.913715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3b40d-d324-4ca3-a9c1-2a511aa7e620 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:08.914278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3b40d-d324-4ca3-a9c1-2a511aa7e620 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:08.914550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3b40d-d324-4ca3-a9c1-2a511aa7e620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:08.916737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] The token cache is being invalidate because project 061787b648cd4467b9148243bed40b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:08.917061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:08.917768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c214f4ea-ce2a-4448-9670-7c262b039f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:08.920033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 958/1902] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:08 2022] DELETE /identity/v3/projects/061787b648cd4467b9148243bed40b8b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:08.928783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312d1fd-807f-4217-93bd-0ff2a24c83ea None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:08.929173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312d1fd-807f-4217-93bd-0ff2a24c83ea None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:08.929526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312d1fd-807f-4217-93bd-0ff2a24c83ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:08.939269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-15c3b40d-d324-4ca3-a9c1-2a511aa7e620 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:08.941188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-15c3b40d-d324-4ca3-a9c1-2a511aa7e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:08.953008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3312d1fd-807f-4217-93bd-0ff2a24c83ea None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:08.957611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3312d1fd-807f-4217-93bd-0ff2a24c83ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:09.043996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 945/1903] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:09.056393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3b40d-d324-4ca3-a9c1-2a511aa7e620 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:09.059248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-15c3b40d-d324-4ca3-a9c1-2a511aa7e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:09.093746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 959/1904] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:09.102286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971a8ac-ff40-478b-9b08-0aa44b5fc8a7 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.102715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971a8ac-ff40-478b-9b08-0aa44b5fc8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.103235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971a8ac-ff40-478b-9b08-0aa44b5fc8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.123308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4971a8ac-ff40-478b-9b08-0aa44b5fc8a7 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:09.124679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4971a8ac-ff40-478b-9b08-0aa44b5fc8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:09.135442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 960/1905] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:09.141306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971a8ac-ff40-478b-9b08-0aa44b5fc8a7 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:09.149733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3b40d-d324-4ca3-a9c1-2a511aa7e620 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:09.151653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971a8ac-ff40-478b-9b08-0aa44b5fc8a7 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:09.154643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2b22a-75de-4d40-9075-ae5663a5c0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:09.155307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2b22a-75de-4d40-9075-ae5663a5c0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.155593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2b22a-75de-4d40-9075-ae5663a5c0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.155870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2b22a-75de-4d40-9075-ae5663a5c0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.157042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d6d42-79d7-4ae0-bc07-b83d9b45b109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:09.157943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d6d42-79d7-4ae0-bc07-b83d9b45b109 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.158231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d6d42-79d7-4ae0-bc07-b83d9b45b109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.158544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d6d42-79d7-4ae0-bc07-b83d9b45b109 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.159857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d6d42-79d7-4ae0-bc07-b83d9b45b109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:09.160172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d6d42-79d7-4ae0-bc07-b83d9b45b109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:09.163395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d6d42-79d7-4ae0-bc07-b83d9b45b109 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:09.165215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:09.167855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2b22a-75de-4d40-9075-ae5663a5c0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:09.169298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2b22a-75de-4d40-9075-ae5663a5c0d9 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:09.183326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 946/1906] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:09.184983 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 961/1907] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:09.189367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2b22a-75de-4d40-9075-ae5663a5c0d9 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:09.199690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2b22a-75de-4d40-9075-ae5663a5c0d9 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:09.204736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b5b2a-993a-4a42-bf46-33547338c554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:09.205473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b5b2a-993a-4a42-bf46-33547338c554 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.205831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b5b2a-993a-4a42-bf46-33547338c554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.206216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b5b2a-993a-4a42-bf46-33547338c554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.207000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b5b2a-993a-4a42-bf46-33547338c554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:09.209152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b5b2a-993a-4a42-bf46-33547338c554 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:09.242600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 947/1908] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:09 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:09.244179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d6d42-79d7-4ae0-bc07-b83d9b45b109 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:09.256345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d6d42-79d7-4ae0-bc07-b83d9b45b109 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:09.332077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb8a55-182d-48ef-ab0e-eb55e66d39ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:09.332876 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb8a55-182d-48ef-ab0e-eb55e66d39ae admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.333282 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb8a55-182d-48ef-ab0e-eb55e66d39ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.333633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb8a55-182d-48ef-ab0e-eb55e66d39ae admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.334479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb8a55-182d-48ef-ab0e-eb55e66d39ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:09.336516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb8a55-182d-48ef-ab0e-eb55e66d39ae admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:09.368486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 962/1909] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:09 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:09.373027 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b5b2a-993a-4a42-bf46-33547338c554 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:09.394386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:09.402433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b5b2a-993a-4a42-bf46-33547338c554 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:09.410394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfaac3-40b2-4d5f-a663-9a3bf8756c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:09.412419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfaac3-40b2-4d5f-a663-9a3bf8756c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.412961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfaac3-40b2-4d5f-a663-9a3bf8756c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.413773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfaac3-40b2-4d5f-a663-9a3bf8756c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.414754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfaac3-40b2-4d5f-a663-9a3bf8756c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:09.416521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfaac3-40b2-4d5f-a663-9a3bf8756c2b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:09.434253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 948/1910] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:09.435548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb8a55-182d-48ef-ab0e-eb55e66d39ae admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:09.448295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb8a55-182d-48ef-ab0e-eb55e66d39ae admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:09.454092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f77722-8566-41ca-8778-c669faf703aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:09.455103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f77722-8566-41ca-8778-c669faf703aa admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.455358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f77722-8566-41ca-8778-c669faf703aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.455499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f77722-8566-41ca-8778-c669faf703aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.456300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f77722-8566-41ca-8778-c669faf703aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:09.458194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f77722-8566-41ca-8778-c669faf703aa admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:09.470448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 963/1911] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:09.475642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfaac3-40b2-4d5f-a663-9a3bf8756c2b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:09.498906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfaac3-40b2-4d5f-a663-9a3bf8756c2b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:09.507039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba440c-21be-4eaf-9b8a-e97fc297e868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:09.511572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba440c-21be-4eaf-9b8a-e97fc297e868 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.511572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba440c-21be-4eaf-9b8a-e97fc297e868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.511572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba440c-21be-4eaf-9b8a-e97fc297e868 admin admin] PATH_INFO: `/v3/projects/aaadf1476366465392fb793ad15790fb/users/5ea4adb259e84643b3f79ac5a8727562/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.536723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba440c-21be-4eaf-9b8a-e97fc297e868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaadf1476366465392fb793ad15790fb, user_id=5ea4adb259e84643b3f79ac5a8727562, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:09.542313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba440c-21be-4eaf-9b8a-e97fc297e868 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:09.573221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 949/1912] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:09 2022] PUT /identity/v3/projects/aaadf1476366465392fb793ad15790fb/users/5ea4adb259e84643b3f79ac5a8727562/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:09.574178 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853fe32-6507-47d9-ab7e-1fe96264cdeb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.574515 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853fe32-6507-47d9-ab7e-1fe96264cdeb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.574891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853fe32-6507-47d9-ab7e-1fe96264cdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.577282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba440c-21be-4eaf-9b8a-e97fc297e868 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:09.579769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-caba440c-21be-4eaf-9b8a-e97fc297e868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:09.640201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f853fe32-6507-47d9-ab7e-1fe96264cdeb None None] MFA Rules not processed for user `5ea4adb259e84643b3f79ac5a8727562`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:09.641448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f853fe32-6507-47d9-ab7e-1fe96264cdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:09.719306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba440c-21be-4eaf-9b8a-e97fc297e868 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:09.727350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:09.728750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.729330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.729620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] PATH_INFO: `/v3/projects/22d27e58538f4e21b06a404a77398165` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.731192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d27e58538f4e21b06a404a77398165)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:09.733743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:09.770797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 964/1913] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:09.782892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853fe32-6507-47d9-ab7e-1fe96264cdeb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:09.785747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f853fe32-6507-47d9-ab7e-1fe96264cdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:09.841558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d27e58538f4e21b06a404a77398165', 'request_id': 'req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:09.849478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d27e58538f4e21b06a404a77398165', 'request_id': 'req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:09.858999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d27e58538f4e21b06a404a77398165', 'request_id': 'req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:09.884905 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853fe32-6507-47d9-ab7e-1fe96264cdeb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:09.886139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] The token cache is being invalidate because project 22d27e58538f4e21b06a404a77398165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:09.886609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:09.888798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:09.894662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 950/1914] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:09 2022] DELETE /identity/v3/projects/22d27e58538f4e21b06a404a77398165 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:09.895876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:09.897285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:09.920434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:09.955915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422bd7b-219a-4d24-9f81-12d6d0f53e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:09.956726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422bd7b-219a-4d24-9f81-12d6d0f53e4d service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:09.957015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422bd7b-219a-4d24-9f81-12d6d0f53e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:09.957297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422bd7b-219a-4d24-9f81-12d6d0f53e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:09.959437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0422bd7b-219a-4d24-9f81-12d6d0f53e4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:10.001026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:10.007263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b2f75-8d6f-4b09-a151-b0e739fd1930 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:10.016434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:10.018596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:10.019100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:10.019619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] PATH_INFO: `/v3/users/d09d4f10e014447b9d2b241035e32ef2` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:10.022963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09d4f10e014447b9d2b241035e32ef2)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:10.030842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:10.090207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422bd7b-219a-4d24-9f81-12d6d0f53e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:10.091797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422bd7b-219a-4d24-9f81-12d6d0f53e4d service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:10.104622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 965/1915] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:10.117090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09d4f10e014447b9d2b241035e32ef2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.118301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09d4f10e014447b9d2b241035e32ef2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.119052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09d4f10e014447b9d2b241035e32ef2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.131892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422bd7b-219a-4d24-9f81-12d6d0f53e4d service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:10.134155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0422bd7b-219a-4d24-9f81-12d6d0f53e4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:10.142143 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09d4f10e014447b9d2b241035e32ef2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.152230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-60a7d746-359d-49d3-a86f-87b533b92a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09d4f10e014447b9d2b241035e32ef2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.164012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422bd7b-219a-4d24-9f81-12d6d0f53e4d service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:10.174092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 951/1916] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:09 2022] DELETE /identity/v3/users/d09d4f10e014447b9d2b241035e32ef2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:10.185312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:10.187220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:10.189103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:10.189540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] PATH_INFO: `/v3/users/5ea4adb259e84643b3f79ac5a8727562` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:10.192902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea4adb259e84643b3f79ac5a8727562)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:10.200171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:10.314567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea4adb259e84643b3f79ac5a8727562'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.321126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea4adb259e84643b3f79ac5a8727562'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.333112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea4adb259e84643b3f79ac5a8727562'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.347531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea4adb259e84643b3f79ac5a8727562'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.356035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea4adb259e84643b3f79ac5a8727562'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.367751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 966/1917] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:10 2022] DELETE /identity/v3/users/5ea4adb259e84643b3f79ac5a8727562 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:10.375351 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557ee4-3f2f-474c-98fd-3fb459245260 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:10.376190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557ee4-3f2f-474c-98fd-3fb459245260 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:10.376823 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557ee4-3f2f-474c-98fd-3fb459245260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:10.397425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-23557ee4-3f2f-474c-98fd-3fb459245260 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:10.399017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-23557ee4-3f2f-474c-98fd-3fb459245260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:10.463794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 952/1918] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:10.473558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:10.475005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:10.534053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:10.566537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b99afd-9098-4bab-b48e-a45227fc456f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:10.572506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6ef6c-5899-4674-af9a-3fe6602c29d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:10.573730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6ef6c-5899-4674-af9a-3fe6602c29d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:10.577618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6ef6c-5899-4674-af9a-3fe6602c29d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:10.577912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6ef6c-5899-4674-af9a-3fe6602c29d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:10.591262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6ef6c-5899-4674-af9a-3fe6602c29d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:10.592814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6ef6c-5899-4674-af9a-3fe6602c29d5 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:10.608939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 967/1919] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:10.620085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557ee4-3f2f-474c-98fd-3fb459245260 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:10.621669 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-23557ee4-3f2f-474c-98fd-3fb459245260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:10.641350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557ee4-3f2f-474c-98fd-3fb459245260 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:10.650928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:10.652177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:10.653397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:10.653875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] PATH_INFO: `/v3/projects/c54dd9f89eed4393bf3c1b4170e0b021` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:10.656211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54dd9f89eed4393bf3c1b4170e0b021)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:10.661240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:10.771199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54dd9f89eed4393bf3c1b4170e0b021', 'request_id': 'req-10dbf133-336a-4042-b6af-8c31feee9d1f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.783093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54dd9f89eed4393bf3c1b4170e0b021', 'request_id': 'req-10dbf133-336a-4042-b6af-8c31feee9d1f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.795613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54dd9f89eed4393bf3c1b4170e0b021', 'request_id': 'req-10dbf133-336a-4042-b6af-8c31feee9d1f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.824238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:10.833016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] The token cache is being invalidate because project c54dd9f89eed4393bf3c1b4170e0b021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:10.833579 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.835486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-10dbf133-336a-4042-b6af-8c31feee9d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:10.852143 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e91a-83c1-453d-9776-e9db5ce5bce9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:10.852864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e91a-83c1-453d-9776-e9db5ce5bce9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:10.852864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e91a-83c1-453d-9776-e9db5ce5bce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:10.854621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 953/1920] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:10 2022] DELETE /identity/v3/projects/c54dd9f89eed4393bf3c1b4170e0b021 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:10.881492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4d12e91a-83c1-453d-9776-e9db5ce5bce9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:10.888132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4d12e91a-83c1-453d-9776-e9db5ce5bce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:10.991950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446397b-c21b-4bb2-a3e7-06affbe07eab None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:10.991950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446397b-c21b-4bb2-a3e7-06affbe07eab None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:10.992297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446397b-c21b-4bb2-a3e7-06affbe07eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:10.996624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 968/1921] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:11.022270 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3446397b-c21b-4bb2-a3e7-06affbe07eab None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:11.023963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3446397b-c21b-4bb2-a3e7-06affbe07eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:11.033572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 954/1922] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:11.038172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12e91a-83c1-453d-9776-e9db5ce5bce9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:11.051430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12e91a-83c1-453d-9776-e9db5ce5bce9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:11.056322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9616d-ea4d-4ec1-ab52-2a841ab78425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:11.057071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9616d-ea4d-4ec1-ab52-2a841ab78425 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:11.057425 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9616d-ea4d-4ec1-ab52-2a841ab78425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:11.057774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9616d-ea4d-4ec1-ab52-2a841ab78425 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:11.058701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9616d-ea4d-4ec1-ab52-2a841ab78425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:11.059105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9616d-ea4d-4ec1-ab52-2a841ab78425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:11.060768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9616d-ea4d-4ec1-ab52-2a841ab78425 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:11.077380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 969/1923] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:11.081409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446397b-c21b-4bb2-a3e7-06affbe07eab None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:11.092646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446397b-c21b-4bb2-a3e7-06affbe07eab None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:11.107491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616257f-73bf-4ad0-ae11-797e7446dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:11.112278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616257f-73bf-4ad0-ae11-797e7446dbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:11.112278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616257f-73bf-4ad0-ae11-797e7446dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:11.112278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616257f-73bf-4ad0-ae11-797e7446dbd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:11.112278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616257f-73bf-4ad0-ae11-797e7446dbd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:11.113234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616257f-73bf-4ad0-ae11-797e7446dbd8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:11.154397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 955/1924] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:11 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:33:11.158606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9616d-ea4d-4ec1-ab52-2a841ab78425 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:11.169399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9616d-ea4d-4ec1-ab52-2a841ab78425 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:11.246534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a208aa1-6314-4233-a5e8-879ab2ddb87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:11.247408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a208aa1-6314-4233-a5e8-879ab2ddb87c admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:11.247779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a208aa1-6314-4233-a5e8-879ab2ddb87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:11.248164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a208aa1-6314-4233-a5e8-879ab2ddb87c admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:11.249106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a208aa1-6314-4233-a5e8-879ab2ddb87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:11.251127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a208aa1-6314-4233-a5e8-879ab2ddb87c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:11.277155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 970/1925] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:11 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:11.281021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616257f-73bf-4ad0-ae11-797e7446dbd8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:11.302670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616257f-73bf-4ad0-ae11-797e7446dbd8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:11.310868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73fdff-b2c1-4322-ac16-d40b176478e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:11.311557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73fdff-b2c1-4322-ac16-d40b176478e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:11.311843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73fdff-b2c1-4322-ac16-d40b176478e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:11.312122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73fdff-b2c1-4322-ac16-d40b176478e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:11.313046 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73fdff-b2c1-4322-ac16-d40b176478e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:11.314732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73fdff-b2c1-4322-ac16-d40b176478e4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:11.327529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 956/1926] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:11.331912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a208aa1-6314-4233-a5e8-879ab2ddb87c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:11.343773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a208aa1-6314-4233-a5e8-879ab2ddb87c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:11.349612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7fda0-cc5e-47d7-b288-31437c35e3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:11.350822 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7fda0-cc5e-47d7-b288-31437c35e3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:11.350822 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7fda0-cc5e-47d7-b288-31437c35e3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:11.351032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7fda0-cc5e-47d7-b288-31437c35e3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:11.351757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7fda0-cc5e-47d7-b288-31437c35e3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:11.353455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7fda0-cc5e-47d7-b288-31437c35e3e5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:11.371544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 971/1927] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:11.373174 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73fdff-b2c1-4322-ac16-d40b176478e4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:11.388322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73fdff-b2c1-4322-ac16-d40b176478e4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:11.401820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a43eed-8cdd-49ec-a79b-a6f09856a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:11.402952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a43eed-8cdd-49ec-a79b-a6f09856a7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:11.403372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a43eed-8cdd-49ec-a79b-a6f09856a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:11.403871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a43eed-8cdd-49ec-a79b-a6f09856a7b5 admin admin] PATH_INFO: `/v3/projects/2104f6ad820245879672231546d9d138/users/200348af1fb345749d4ab0a344e445af/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:11.426064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a43eed-8cdd-49ec-a79b-a6f09856a7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2104f6ad820245879672231546d9d138, user_id=200348af1fb345749d4ab0a344e445af, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:11.430048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a43eed-8cdd-49ec-a79b-a6f09856a7b5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:11.459391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266d264-4737-4496-bf9a-b9d836b28cc5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:11.459696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266d264-4737-4496-bf9a-b9d836b28cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:11.460101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266d264-4737-4496-bf9a-b9d836b28cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:11.463137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 957/1928] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:11 2022] PUT /identity/v3/projects/2104f6ad820245879672231546d9d138/users/200348af1fb345749d4ab0a344e445af/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:11.512771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e266d264-4737-4496-bf9a-b9d836b28cc5 None None] MFA Rules not processed for user `200348af1fb345749d4ab0a344e445af`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:11.514339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e266d264-4737-4496-bf9a-b9d836b28cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:11.578775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:11.618553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 972/1929] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:11.619926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a43eed-8cdd-49ec-a79b-a6f09856a7b5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:11.758129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a43eed-8cdd-49ec-a79b-a6f09856a7b5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:11.765729 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ed84e-ac08-4a2c-8f4a-64e09891a331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:11.766447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed84e-ac08-4a2c-8f4a-64e09891a331 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:11.766733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed84e-ac08-4a2c-8f4a-64e09891a331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:11.767007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed84e-ac08-4a2c-8f4a-64e09891a331 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:11.768012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ed84e-ac08-4a2c-8f4a-64e09891a331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:11.770796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ed84e-ac08-4a2c-8f4a-64e09891a331 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:11.813013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 958/1930] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:11 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:11.822697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266d264-4737-4496-bf9a-b9d836b28cc5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:11.835145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266d264-4737-4496-bf9a-b9d836b28cc5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:11.962570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d9dc-9513-4584-abd2-f39ce5ee3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:11.963404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d9dc-9513-4584-abd2-f39ce5ee3563 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:11.963801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d9dc-9513-4584-abd2-f39ce5ee3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:11.964139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d9dc-9513-4584-abd2-f39ce5ee3563 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:11.965133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0d9dc-9513-4584-abd2-f39ce5ee3563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:11.967614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0d9dc-9513-4584-abd2-f39ce5ee3563 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:11.986460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ed84e-ac08-4a2c-8f4a-64e09891a331 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:11.989936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e77ed84e-ac08-4a2c-8f4a-64e09891a331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:12.007234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 973/1931] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:11 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:12.011298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d9dc-9513-4584-abd2-f39ce5ee3563 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:12.024509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ed84e-ac08-4a2c-8f4a-64e09891a331 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:12.025162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0d9dc-9513-4584-abd2-f39ce5ee3563 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:12.031744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6ea27-5fcc-4445-a0e0-cc5beb8614dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:12.032364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6ea27-5fcc-4445-a0e0-cc5beb8614dc admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.033024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6ea27-5fcc-4445-a0e0-cc5beb8614dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.033406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6ea27-5fcc-4445-a0e0-cc5beb8614dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.034606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6ea27-5fcc-4445-a0e0-cc5beb8614dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:12.035599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:12.037154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.037293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6ea27-5fcc-4445-a0e0-cc5beb8614dc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:12.037385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.037385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] PATH_INFO: `/v3/projects/aaadf1476366465392fb793ad15790fb` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.038593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaadf1476366465392fb793ad15790fb)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:12.041978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:12.053278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 974/1932] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:12.059014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6ea27-5fcc-4445-a0e0-cc5beb8614dc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:12.070883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6ea27-5fcc-4445-a0e0-cc5beb8614dc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:12.078437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7dc09-b091-444c-96bb-5d553219403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:12.079503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7dc09-b091-444c-96bb-5d553219403e admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.079888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7dc09-b091-444c-96bb-5d553219403e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.080263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7dc09-b091-444c-96bb-5d553219403e admin admin] PATH_INFO: `/v3/projects/14e0e4e23c4741cbb143af2d9229ce2a/users/581648f6b7884733a16e41d75167ec0f/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.102483 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7dc09-b091-444c-96bb-5d553219403e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e0e4e23c4741cbb143af2d9229ce2a, user_id=581648f6b7884733a16e41d75167ec0f, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:12.105325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7dc09-b091-444c-96bb-5d553219403e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:12.118719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaadf1476366465392fb793ad15790fb', 'request_id': 'req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:12.129813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 975/1933] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:12 2022] PUT /identity/v3/projects/14e0e4e23c4741cbb143af2d9229ce2a/users/581648f6b7884733a16e41d75167ec0f/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:12.133827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaadf1476366465392fb793ad15790fb', 'request_id': 'req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:12.135056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7dc09-b091-444c-96bb-5d553219403e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:12.145571 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaadf1476366465392fb793ad15790fb', 'request_id': 'req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:12.186306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] The token cache is being invalidate because project aaadf1476366465392fb793ad15790fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:12.187444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:12.188548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53f6897a-8d3e-4592-9bc7-1e4fbe0fc988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:12.196849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 959/1934] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:11 2022] DELETE /identity/v3/projects/aaadf1476366465392fb793ad15790fb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:12.203657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42285c75-3a7c-4960-81cd-0971d82f9b22 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.203657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42285c75-3a7c-4960-81cd-0971d82f9b22 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.203657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42285c75-3a7c-4960-81cd-0971d82f9b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.217377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:12.249978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-42285c75-3a7c-4960-81cd-0971d82f9b22 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:12.251264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-42285c75-3a7c-4960-81cd-0971d82f9b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:12.319229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7dc09-b091-444c-96bb-5d553219403e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:12.343214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee8a27-e788-4286-9779-323f3a88dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:12.344426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee8a27-e788-4286-9779-323f3a88dbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.344733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee8a27-e788-4286-9779-323f3a88dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.345019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee8a27-e788-4286-9779-323f3a88dbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.346040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee8a27-e788-4286-9779-323f3a88dbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:12.348782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee8a27-e788-4286-9779-323f3a88dbb3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:12.365498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 960/1935] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:12.369260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca554-29d4-4d7d-aac7-85cb12ef98b5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.369784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca554-29d4-4d7d-aac7-85cb12ef98b5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.370165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca554-29d4-4d7d-aac7-85cb12ef98b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.375706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 976/1936] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:12.380660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee8a27-e788-4286-9779-323f3a88dbb3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:12.384474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ddee8a27-e788-4286-9779-323f3a88dbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:12.410561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee8a27-e788-4286-9779-323f3a88dbb3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:12.418179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43372de1-16ca-4e4f-ad1e-f555891bed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:12.418840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43372de1-16ca-4e4f-ad1e-f555891bed2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.419122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43372de1-16ca-4e4f-ad1e-f555891bed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.419449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43372de1-16ca-4e4f-ad1e-f555891bed2d admin admin] PATH_INFO: `/v3/projects/14e0e4e23c4741cbb143af2d9229ce2a/users/581648f6b7884733a16e41d75167ec0f/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.421792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43372de1-16ca-4e4f-ad1e-f555891bed2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e0e4e23c4741cbb143af2d9229ce2a, user_id=581648f6b7884733a16e41d75167ec0f, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:12.426517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43372de1-16ca-4e4f-ad1e-f555891bed2d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:12.434903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8d6ca554-29d4-4d7d-aac7-85cb12ef98b5 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:12.436469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8d6ca554-29d4-4d7d-aac7-85cb12ef98b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:12.459142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 977/1937] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:12 2022] PUT /identity/v3/projects/14e0e4e23c4741cbb143af2d9229ce2a/users/581648f6b7884733a16e41d75167ec0f/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:12.461338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57cbc1-75e1-4da4-84c5-355d8bbac693 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.461636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57cbc1-75e1-4da4-84c5-355d8bbac693 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.461918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57cbc1-75e1-4da4-84c5-355d8bbac693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.465272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 961/1938] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:12.466392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca554-29d4-4d7d-aac7-85cb12ef98b5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:12.487890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca554-29d4-4d7d-aac7-85cb12ef98b5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:12.521799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ba57cbc1-75e1-4da4-84c5-355d8bbac693 None None] MFA Rules not processed for user `581648f6b7884733a16e41d75167ec0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:12.523190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ba57cbc1-75e1-4da4-84c5-355d8bbac693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:12.574533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:12.623809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cabd0e-2388-4e9e-b346-365292f99549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:12.624495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabd0e-2388-4e9e-b346-365292f99549 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.624786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabd0e-2388-4e9e-b346-365292f99549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.625060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabd0e-2388-4e9e-b346-365292f99549 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.626049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabd0e-2388-4e9e-b346-365292f99549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:12.626640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabd0e-2388-4e9e-b346-365292f99549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:12.628803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabd0e-2388-4e9e-b346-365292f99549 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:12.646404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 962/1939] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:12.647376 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cabd0e-2388-4e9e-b346-365292f99549 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:12.659131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cabd0e-2388-4e9e-b346-365292f99549 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:12.664167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6d92b-4803-4afa-ac0a-aaf178a9a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:12.664845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6d92b-4803-4afa-ac0a-aaf178a9a8df admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.665127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6d92b-4803-4afa-ac0a-aaf178a9a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.665404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6d92b-4803-4afa-ac0a-aaf178a9a8df admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.666102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6d92b-4803-4afa-ac0a-aaf178a9a8df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:12.668225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6d92b-4803-4afa-ac0a-aaf178a9a8df admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:12.710066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 963/1940] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:12 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:12.712189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 978/1941] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:12.714248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6d92b-4803-4afa-ac0a-aaf178a9a8df admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:12.726796 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57cbc1-75e1-4da4-84c5-355d8bbac693 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:12.730164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ba57cbc1-75e1-4da4-84c5-355d8bbac693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:12.821952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57cbc1-75e1-4da4-84c5-355d8bbac693 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:12.856883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6d92b-4803-4afa-ac0a-aaf178a9a8df admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:12.874471 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb30f-6eec-4bdf-bc3e-36fbd56dac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:12.875455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb30f-6eec-4bdf-bc3e-36fbd56dac10 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.876766 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb30f-6eec-4bdf-bc3e-36fbd56dac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.877101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb30f-6eec-4bdf-bc3e-36fbd56dac10 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.877817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9eb30f-6eec-4bdf-bc3e-36fbd56dac10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:12.880743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9eb30f-6eec-4bdf-bc3e-36fbd56dac10 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:12.907856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:12.924621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 964/1942] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:12 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:33:12.942967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e36ccd-03b2-4f8e-9867-476152072eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:12.943815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36ccd-03b2-4f8e-9867-476152072eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.944700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36ccd-03b2-4f8e-9867-476152072eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.945471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36ccd-03b2-4f8e-9867-476152072eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.946478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb30f-6eec-4bdf-bc3e-36fbd56dac10 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:12.971458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb30f-6eec-4bdf-bc3e-36fbd56dac10 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:12.994016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fee9d-41cb-4719-a274-ceb5c2d18232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:12.995030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fee9d-41cb-4719-a274-ceb5c2d18232 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:12.995449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fee9d-41cb-4719-a274-ceb5c2d18232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:12.995583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fee9d-41cb-4719-a274-ceb5c2d18232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:12.997045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fee9d-41cb-4719-a274-ceb5c2d18232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:12.998989 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fee9d-41cb-4719-a274-ceb5c2d18232 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:13.013454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 965/1943] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:13.017719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fee9d-41cb-4719-a274-ceb5c2d18232 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:13.032297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fee9d-41cb-4719-a274-ceb5c2d18232 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:13.044290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa54f9-f60e-488a-8267-92322a15a696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:13.045231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa54f9-f60e-488a-8267-92322a15a696 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:13.045670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa54f9-f60e-488a-8267-92322a15a696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:13.045936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa54f9-f60e-488a-8267-92322a15a696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:13.047995 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa54f9-f60e-488a-8267-92322a15a696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:13.050886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa54f9-f60e-488a-8267-92322a15a696 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:13.055496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e36ccd-03b2-4f8e-9867-476152072eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:13.056971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e36ccd-03b2-4f8e-9867-476152072eb0 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:13.066018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 966/1944] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:13.070158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa54f9-f60e-488a-8267-92322a15a696 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:13.087221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 979/1945] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:13.090258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa54f9-f60e-488a-8267-92322a15a696 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:13.096193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce1466-ffa9-4a26-8fde-5defebad87af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:13.098781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce1466-ffa9-4a26-8fde-5defebad87af admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:13.099067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce1466-ffa9-4a26-8fde-5defebad87af admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:13.099352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce1466-ffa9-4a26-8fde-5defebad87af admin admin] PATH_INFO: `/v3/projects/e4be3edce00646a48bd0562dc682ee04/users/869b2c55da714f2aa1c6b29c39d03ba1/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:13.125868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce1466-ffa9-4a26-8fde-5defebad87af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4be3edce00646a48bd0562dc682ee04, user_id=869b2c55da714f2aa1c6b29c39d03ba1, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:13.129517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce1466-ffa9-4a26-8fde-5defebad87af admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:13.154944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 967/1946] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:13 2022] PUT /identity/v3/projects/e4be3edce00646a48bd0562dc682ee04/users/869b2c55da714f2aa1c6b29c39d03ba1/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:13.168716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593e03-2912-4b85-90cc-f989ae9b576f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:13.169008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593e03-2912-4b85-90cc-f989ae9b576f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:13.169437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593e03-2912-4b85-90cc-f989ae9b576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:13.193994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:13.228671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-04593e03-2912-4b85-90cc-f989ae9b576f None None] MFA Rules not processed for user `869b2c55da714f2aa1c6b29c39d03ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:13.229980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-04593e03-2912-4b85-90cc-f989ae9b576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:13.266682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce1466-ffa9-4a26-8fde-5defebad87af admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:13.316546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 980/1947] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:13.327644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04593e03-2912-4b85-90cc-f989ae9b576f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:13.338037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce1466-ffa9-4a26-8fde-5defebad87af admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:13.348278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:13.349302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:13.349590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:13.349869 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] PATH_INFO: `/v3/users/200348af1fb345749d4ab0a344e445af` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:13.351126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=200348af1fb345749d4ab0a344e445af)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:13.353079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:13.392060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04593e03-2912-4b85-90cc-f989ae9b576f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:13.396388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f9d7f-0b61-4dfe-b2c1-16e3f2a0fdf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:13.397155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f9d7f-0b61-4dfe-b2c1-16e3f2a0fdf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:13.397439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f9d7f-0b61-4dfe-b2c1-16e3f2a0fdf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:13.397724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f9d7f-0b61-4dfe-b2c1-16e3f2a0fdf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:13.402968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '200348af1fb345749d4ab0a344e445af'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:13.403665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '200348af1fb345749d4ab0a344e445af'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:13.404414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '200348af1fb345749d4ab0a344e445af'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:13.406941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f9d7f-0b61-4dfe-b2c1-16e3f2a0fdf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:13.408481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f9d7f-0b61-4dfe-b2c1-16e3f2a0fdf6 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:13.418137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 981/1948] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:13.426704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '200348af1fb345749d4ab0a344e445af'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:13.437505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ba655a53-2686-4417-8d18-494537cab31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '200348af1fb345749d4ab0a344e445af'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:13.438724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f9d7f-0b61-4dfe-b2c1-16e3f2a0fdf6 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:13.449842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 968/1949] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:13 2022] DELETE /identity/v3/users/200348af1fb345749d4ab0a344e445af => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:13.454417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f9d7f-0b61-4dfe-b2c1-16e3f2a0fdf6 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:13.454847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b964-ea90-4fa0-a7c7-40092fb816b3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:13.455214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b964-ea90-4fa0-a7c7-40092fb816b3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:13.455553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b964-ea90-4fa0-a7c7-40092fb816b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:13.473032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e028b964-ea90-4fa0-a7c7-40092fb816b3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:13.474443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e028b964-ea90-4fa0-a7c7-40092fb816b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:13.509290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:13.521376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:13.522412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:13.522698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:13.522997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] PATH_INFO: `/v3/users/869b2c55da714f2aa1c6b29c39d03ba1` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:13.524539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=869b2c55da714f2aa1c6b29c39d03ba1)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:13.526622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:13.544606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 969/1950] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:13.555081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b964-ea90-4fa0-a7c7-40092fb816b3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:13.556763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e028b964-ea90-4fa0-a7c7-40092fb816b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:13.585759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:13.588529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869b2c55da714f2aa1c6b29c39d03ba1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:13.589458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869b2c55da714f2aa1c6b29c39d03ba1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:13.610369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869b2c55da714f2aa1c6b29c39d03ba1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:13.629486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869b2c55da714f2aa1c6b29c39d03ba1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:13.639471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-cd148565-cd5c-4933-bb82-d46b402916f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869b2c55da714f2aa1c6b29c39d03ba1'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:13.651697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 982/1951] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:13 2022] DELETE /identity/v3/users/869b2c55da714f2aa1c6b29c39d03ba1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:13.652427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b964-ea90-4fa0-a7c7-40092fb816b3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:13.656903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7756b0-bf49-4ecf-a187-63dcef4cc405 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:13.657920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7756b0-bf49-4ecf-a187-63dcef4cc405 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:13.657920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7756b0-bf49-4ecf-a187-63dcef4cc405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:13.697113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dc7756b0-bf49-4ecf-a187-63dcef4cc405 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:13.698264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dc7756b0-bf49-4ecf-a187-63dcef4cc405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:13.734006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7f5f-caca-402e-8548-e500bcad28bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:13.734752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7f5f-caca-402e-8548-e500bcad28bb service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:13.735325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7f5f-caca-402e-8548-e500bcad28bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:13.735605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7f5f-caca-402e-8548-e500bcad28bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:13.739397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-828e7f5f-caca-402e-8548-e500bcad28bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:13.818260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 983/1952] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:13.833422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7756b0-bf49-4ecf-a187-63dcef4cc405 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:13.835073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dc7756b0-bf49-4ecf-a187-63dcef4cc405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:13.856022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7756b0-bf49-4ecf-a187-63dcef4cc405 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:13.859955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa80bca-045f-4d0f-aece-fee46679c4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:13.860624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa80bca-045f-4d0f-aece-fee46679c4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:13.861171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa80bca-045f-4d0f-aece-fee46679c4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:13.861510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa80bca-045f-4d0f-aece-fee46679c4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:13.862066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e7f5f-caca-402e-8548-e500bcad28bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:13.863930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e7f5f-caca-402e-8548-e500bcad28bb service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:13.880172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 970/1953] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:13.887451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa80bca-045f-4d0f-aece-fee46679c4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:13.889220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa80bca-045f-4d0f-aece-fee46679c4b6 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:13.904111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 984/1954] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:14.230776 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7f5f-caca-402e-8548-e500bcad28bb service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:14.232641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-828e7f5f-caca-402e-8548-e500bcad28bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:14.263337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7f5f-caca-402e-8548-e500bcad28bb service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:14.286710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:14.288745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:14.289144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:14.289514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] PATH_INFO: `/v3/projects/e4be3edce00646a48bd0562dc682ee04` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:14.291337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4be3edce00646a48bd0562dc682ee04)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:14.294517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:14.356767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:14.373461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4be3edce00646a48bd0562dc682ee04', 'request_id': 'req-f95fa47c-1399-4961-8c2d-93c5ad25904b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:14.386236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4be3edce00646a48bd0562dc682ee04', 'request_id': 'req-f95fa47c-1399-4961-8c2d-93c5ad25904b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:14.395947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4be3edce00646a48bd0562dc682ee04', 'request_id': 'req-f95fa47c-1399-4961-8c2d-93c5ad25904b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:14.432175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] The token cache is being invalidate because project e4be3edce00646a48bd0562dc682ee04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:14.432380 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:14.433281 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:14.435643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 971/1955] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:14 2022] DELETE /identity/v3/projects/e4be3edce00646a48bd0562dc682ee04 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:14.441095 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7f1de-63b1-4993-af4a-c800e1b0b090 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:14.441617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7f1de-63b1-4993-af4a-c800e1b0b090 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:14.441695 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7f1de-63b1-4993-af4a-c800e1b0b090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:14.467783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dbc7f1de-63b1-4993-af4a-c800e1b0b090 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:14.470718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dbc7f1de-63b1-4993-af4a-c800e1b0b090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:14.542518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:14.544081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:14.649665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 985/1956] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:14.658437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be766-2d24-413a-8946-b6a20353b80b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:14.658780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be766-2d24-413a-8946-b6a20353b80b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:14.659131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be766-2d24-413a-8946-b6a20353b80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:14.683251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a56be766-2d24-413a-8946-b6a20353b80b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:14.684461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a56be766-2d24-413a-8946-b6a20353b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:14.692479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fa47c-1399-4961-8c2d-93c5ad25904b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:14.697430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 986/1957] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:14.698669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be766-2d24-413a-8946-b6a20353b80b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:14.701934 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:14.703435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:14.703871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:14.704468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] PATH_INFO: `/v3/projects/2104f6ad820245879672231546d9d138` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:14.707019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2104f6ad820245879672231546d9d138)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:14.709288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:14.715045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be766-2d24-413a-8946-b6a20353b80b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:14.724135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d4d34-0884-4ba4-9514-8835ec85b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:14.725538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d4d34-0884-4ba4-9514-8835ec85b92f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:14.725832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d4d34-0884-4ba4-9514-8835ec85b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:14.726117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d4d34-0884-4ba4-9514-8835ec85b92f admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:14.727076 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d4d34-0884-4ba4-9514-8835ec85b92f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:14.727561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d4d34-0884-4ba4-9514-8835ec85b92f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:14.729884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d4d34-0884-4ba4-9514-8835ec85b92f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:14.747612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 987/1958] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:33:14.752215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d4d34-0884-4ba4-9514-8835ec85b92f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:14.767150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d4d34-0884-4ba4-9514-8835ec85b92f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:14.790285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2104f6ad820245879672231546d9d138', 'request_id': 'req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:14.797703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2104f6ad820245879672231546d9d138', 'request_id': 'req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:14.813815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2104f6ad820245879672231546d9d138', 'request_id': 'req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:14.818127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:14.830001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] The token cache is being invalidate because project 2104f6ad820245879672231546d9d138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:14.830444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:14.831435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:14.837298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 972/1959] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:14 2022] DELETE /identity/v3/projects/2104f6ad820245879672231546d9d138 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:14.841562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:14.844037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:14.858507 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293711c4-bc6a-4f09-8b0b-13483db8d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:14.859313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293711c4-bc6a-4f09-8b0b-13483db8d06a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:14.859972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293711c4-bc6a-4f09-8b0b-13483db8d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:14.860081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293711c4-bc6a-4f09-8b0b-13483db8d06a admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:14.860933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293711c4-bc6a-4f09-8b0b-13483db8d06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:14.863860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293711c4-bc6a-4f09-8b0b-13483db8d06a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:14.906131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 988/1960] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:14 2022] POST /identity/v3/projects => generated 397 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:14.907177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293711c4-bc6a-4f09-8b0b-13483db8d06a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:14.908805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-293711c4-bc6a-4f09-8b0b-13483db8d06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:14.912158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:14.937999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff5ec1-8a20-48c6-bae8-cd9746f8a58b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:15.022995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293711c4-bc6a-4f09-8b0b-13483db8d06a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:15.030811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079157e-a257-48d3-9fb5-94a0dc8a135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:15.032108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079157e-a257-48d3-9fb5-94a0dc8a135a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.032669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079157e-a257-48d3-9fb5-94a0dc8a135a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.033315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079157e-a257-48d3-9fb5-94a0dc8a135a admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.035943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079157e-a257-48d3-9fb5-94a0dc8a135a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:15.042654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079157e-a257-48d3-9fb5-94a0dc8a135a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:15.045738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:15.046822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.047364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.047364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] PATH_INFO: `/v3/users/581648f6b7884733a16e41d75167ec0f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.048778 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581648f6b7884733a16e41d75167ec0f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:15.051768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:15.071379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 989/1961] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:14 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:33:15.072382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079157e-a257-48d3-9fb5-94a0dc8a135a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:15.083419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079157e-a257-48d3-9fb5-94a0dc8a135a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:15.088448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e18adf-69a8-4402-88a0-75e4296a6fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:15.089107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18adf-69a8-4402-88a0-75e4296a6fde admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.089393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18adf-69a8-4402-88a0-75e4296a6fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.089715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18adf-69a8-4402-88a0-75e4296a6fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.090504 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e18adf-69a8-4402-88a0-75e4296a6fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:15.092298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e18adf-69a8-4402-88a0-75e4296a6fde admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:15.106395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 990/1962] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:15.107387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e18adf-69a8-4402-88a0-75e4296a6fde admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:15.110110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581648f6b7884733a16e41d75167ec0f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:15.110804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581648f6b7884733a16e41d75167ec0f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:15.111725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581648f6b7884733a16e41d75167ec0f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:15.118322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e18adf-69a8-4402-88a0-75e4296a6fde admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:15.123089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b597ac-b971-4941-93c9-63514b914433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:15.123745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b597ac-b971-4941-93c9-63514b914433 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.124036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b597ac-b971-4941-93c9-63514b914433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.124326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b597ac-b971-4941-93c9-63514b914433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.124629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581648f6b7884733a16e41d75167ec0f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:15.125053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b597ac-b971-4941-93c9-63514b914433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:15.126692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b597ac-b971-4941-93c9-63514b914433 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:15.131422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e5955095-e880-4569-97dc-4f08b9ea1612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581648f6b7884733a16e41d75167ec0f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:15.139312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 991/1963] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:15.143200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b597ac-b971-4941-93c9-63514b914433 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:15.144881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-08b597ac-b971-4941-93c9-63514b914433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:15.145759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 973/1964] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:14 2022] DELETE /identity/v3/users/581648f6b7884733a16e41d75167ec0f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:15.157533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b597ac-b971-4941-93c9-63514b914433 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:15.226127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79cf57-e504-46db-a258-3727d5c44b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:15.227065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79cf57-e504-46db-a258-3727d5c44b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.227347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79cf57-e504-46db-a258-3727d5c44b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.227626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79cf57-e504-46db-a258-3727d5c44b40 admin admin] PATH_INFO: `/v3/projects/77e9a9d7df4e4699b50523dcde5cfdf3/users/f82bda66eec2431c9206e3ec341c62be/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.248360 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79cf57-e504-46db-a258-3727d5c44b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e9a9d7df4e4699b50523dcde5cfdf3, user_id=f82bda66eec2431c9206e3ec341c62be, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:15.251075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79cf57-e504-46db-a258-3727d5c44b40 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:15.268387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 992/1965] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:15 2022] PUT /identity/v3/projects/77e9a9d7df4e4699b50523dcde5cfdf3/users/f82bda66eec2431c9206e3ec341c62be/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:15.279168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07751a7d-24cb-4145-a2c4-841704e7a624 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.279422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07751a7d-24cb-4145-a2c4-841704e7a624 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.279722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07751a7d-24cb-4145-a2c4-841704e7a624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.325263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-07751a7d-24cb-4145-a2c4-841704e7a624 None None] MFA Rules not processed for user `f82bda66eec2431c9206e3ec341c62be`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:15.326720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-07751a7d-24cb-4145-a2c4-841704e7a624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:15.414507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 974/1966] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:15.425571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79cf57-e504-46db-a258-3727d5c44b40 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:15.428151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cc79cf57-e504-46db-a258-3727d5c44b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:15.444878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:15.501341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07751a7d-24cb-4145-a2c4-841704e7a624 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:15.504246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-07751a7d-24cb-4145-a2c4-841704e7a624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:15.512664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79cf57-e504-46db-a258-3727d5c44b40 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:15.521683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580abbf1-3a0f-4c1c-8513-7c32ecdedbc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:15.522540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbf1-3a0f-4c1c-8513-7c32ecdedbc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.522834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbf1-3a0f-4c1c-8513-7c32ecdedbc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.523115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580abbf1-3a0f-4c1c-8513-7c32ecdedbc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.528317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:15.534126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580abbf1-3a0f-4c1c-8513-7c32ecdedbc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:15.536200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580abbf1-3a0f-4c1c-8513-7c32ecdedbc0 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:15.546409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 993/1967] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:15.615610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07751a7d-24cb-4145-a2c4-841704e7a624 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:15.623578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:15.623887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.624174 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.624450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] PATH_INFO: `/v3/projects/14e0e4e23c4741cbb143af2d9229ce2a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.630258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e0e4e23c4741cbb143af2d9229ce2a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:15.632236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:15.697182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e0e4e23c4741cbb143af2d9229ce2a', 'request_id': 'req-09159e10-e000-4d8c-babf-e9abaa197d8e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:15.705089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e0e4e23c4741cbb143af2d9229ce2a', 'request_id': 'req-09159e10-e000-4d8c-babf-e9abaa197d8e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:15.712347 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e0e4e23c4741cbb143af2d9229ce2a', 'request_id': 'req-09159e10-e000-4d8c-babf-e9abaa197d8e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:15.728707 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] The token cache is being invalidate because project 14e0e4e23c4741cbb143af2d9229ce2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:15.728707 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:15.729309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09159e10-e000-4d8c-babf-e9abaa197d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:15.734176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 975/1968] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:15 2022] DELETE /identity/v3/projects/14e0e4e23c4741cbb143af2d9229ce2a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:15.740230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a1b91-4402-442d-a955-c899c1b39b7b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.740534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a1b91-4402-442d-a955-c899c1b39b7b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.740811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a1b91-4402-442d-a955-c899c1b39b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.758873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1c1a1b91-4402-442d-a955-c899c1b39b7b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:15.760251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1c1a1b91-4402-442d-a955-c899c1b39b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:15.832112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 994/1969] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:15.834466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90ee6-e066-4772-bdc2-57914e68aee3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.835122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90ee6-e066-4772-bdc2-57914e68aee3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.835430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90ee6-e066-4772-bdc2-57914e68aee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.856485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2af90ee6-e066-4772-bdc2-57914e68aee3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:15.857724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2af90ee6-e066-4772-bdc2-57914e68aee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:15.867008 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 976/1970] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:15.871732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a1b91-4402-442d-a955-c899c1b39b7b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:15.882271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a1b91-4402-442d-a955-c899c1b39b7b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:15.890578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba274-25b9-4bda-9bcd-72ae58f1f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:15.890578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba274-25b9-4bda-9bcd-72ae58f1f124 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.890578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba274-25b9-4bda-9bcd-72ae58f1f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.890578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba274-25b9-4bda-9bcd-72ae58f1f124 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.891127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba274-25b9-4bda-9bcd-72ae58f1f124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:15.891249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba274-25b9-4bda-9bcd-72ae58f1f124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:15.892908 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba274-25b9-4bda-9bcd-72ae58f1f124 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:15.907747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 995/1971] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:15.912779 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90ee6-e066-4772-bdc2-57914e68aee3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:15.923789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90ee6-e066-4772-bdc2-57914e68aee3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:15.930404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45046409-0f62-4a40-b854-e4f83cde41ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:15.930855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45046409-0f62-4a40-b854-e4f83cde41ab admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:15.931261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45046409-0f62-4a40-b854-e4f83cde41ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:15.931562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45046409-0f62-4a40-b854-e4f83cde41ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:15.932442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45046409-0f62-4a40-b854-e4f83cde41ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:15.934411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45046409-0f62-4a40-b854-e4f83cde41ab admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:15.965759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 977/1972] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:15 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:15.969870 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba274-25b9-4bda-9bcd-72ae58f1f124 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:15.996421 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba274-25b9-4bda-9bcd-72ae58f1f124 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:16.083920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a3340-bbfa-4f2e-b0b4-5977e79c87bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:16.084614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3340-bbfa-4f2e-b0b4-5977e79c87bc admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.084903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3340-bbfa-4f2e-b0b4-5977e79c87bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.085188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3340-bbfa-4f2e-b0b4-5977e79c87bc admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.085894 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a3340-bbfa-4f2e-b0b4-5977e79c87bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:16.088009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a3340-bbfa-4f2e-b0b4-5977e79c87bc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:16.116671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 996/1973] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:15 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:16.120628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45046409-0f62-4a40-b854-e4f83cde41ab admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:16.136629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45046409-0f62-4a40-b854-e4f83cde41ab admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:16.143129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe5242-d5a5-4588-a466-c859f25a03ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:16.144403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5242-d5a5-4588-a466-c859f25a03ca admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.144819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5242-d5a5-4588-a466-c859f25a03ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.145103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5242-d5a5-4588-a466-c859f25a03ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.145872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe5242-d5a5-4588-a466-c859f25a03ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:16.147695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe5242-d5a5-4588-a466-c859f25a03ca admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:16.159992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 978/1974] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:16.164100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a3340-bbfa-4f2e-b0b4-5977e79c87bc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:16.174407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a3340-bbfa-4f2e-b0b4-5977e79c87bc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:16.179202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dfbc2-e010-440e-9584-a4cdcfd6dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:16.180004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dfbc2-e010-440e-9584-a4cdcfd6dc78 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.180385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dfbc2-e010-440e-9584-a4cdcfd6dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.180676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dfbc2-e010-440e-9584-a4cdcfd6dc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.181419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dfbc2-e010-440e-9584-a4cdcfd6dc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:16.183060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dfbc2-e010-440e-9584-a4cdcfd6dc78 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:16.193757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 997/1975] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:16.198169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe5242-d5a5-4588-a466-c859f25a03ca admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:16.208829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe5242-d5a5-4588-a466-c859f25a03ca admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:16.213861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2c49a-febe-4afd-906d-f0dcb592d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:16.214765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2c49a-febe-4afd-906d-f0dcb592d9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.215455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2c49a-febe-4afd-906d-f0dcb592d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.215730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2c49a-febe-4afd-906d-f0dcb592d9ba admin admin] PATH_INFO: `/v3/projects/6e75ac4d96f44fdba81f8c72fbfbac20/users/e67c8970f21041d4ab13e775901b0e73/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.240357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2c49a-febe-4afd-906d-f0dcb592d9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e75ac4d96f44fdba81f8c72fbfbac20, user_id=e67c8970f21041d4ab13e775901b0e73, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:16.243052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2c49a-febe-4afd-906d-f0dcb592d9ba admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:16.256984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 979/1976] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:16 2022] PUT /identity/v3/projects/6e75ac4d96f44fdba81f8c72fbfbac20/users/e67c8970f21041d4ab13e775901b0e73/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:16.268501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae3d29-7b69-4f86-b80f-7f2507ad6915 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.268501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae3d29-7b69-4f86-b80f-7f2507ad6915 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.268501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae3d29-7b69-4f86-b80f-7f2507ad6915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.295587 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-06ae3d29-7b69-4f86-b80f-7f2507ad6915 None None] MFA Rules not processed for user `e67c8970f21041d4ab13e775901b0e73`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:16.296841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-06ae3d29-7b69-4f86-b80f-7f2507ad6915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:16.300858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:16.367314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 998/1977] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:16.372047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2c49a-febe-4afd-906d-f0dcb592d9ba admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:16.413016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:16.436977 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2c49a-febe-4afd-906d-f0dcb592d9ba admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:16.442072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7ea67-c7d8-4b93-afb1-d14014b8161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:16.442757 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7ea67-c7d8-4b93-afb1-d14014b8161a admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.443040 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7ea67-c7d8-4b93-afb1-d14014b8161a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.443344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7ea67-c7d8-4b93-afb1-d14014b8161a admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.444037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7ea67-c7d8-4b93-afb1-d14014b8161a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:16.445926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7ea67-c7d8-4b93-afb1-d14014b8161a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:16.472348 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 980/1978] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:16 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:16.476339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae3d29-7b69-4f86-b80f-7f2507ad6915 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:16.489602 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae3d29-7b69-4f86-b80f-7f2507ad6915 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:16.552444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc155b4-8b21-4d43-9560-004166451fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:16.553132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc155b4-8b21-4d43-9560-004166451fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.553418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc155b4-8b21-4d43-9560-004166451fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.553696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc155b4-8b21-4d43-9560-004166451fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.554444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc155b4-8b21-4d43-9560-004166451fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:16.556381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc155b4-8b21-4d43-9560-004166451fd8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:16.582919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 999/1979] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:16 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:16.587384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7ea67-c7d8-4b93-afb1-d14014b8161a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:16.599435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7ea67-c7d8-4b93-afb1-d14014b8161a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:16.604990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3312127-bd38-47b8-9ebd-15b9cd08e1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:16.606431 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3312127-bd38-47b8-9ebd-15b9cd08e1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.606759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3312127-bd38-47b8-9ebd-15b9cd08e1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.607101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3312127-bd38-47b8-9ebd-15b9cd08e1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.607991 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3312127-bd38-47b8-9ebd-15b9cd08e1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:16.610847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3312127-bd38-47b8-9ebd-15b9cd08e1f4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:16.626397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 981/1980] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:16.631176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc155b4-8b21-4d43-9560-004166451fd8 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:16.641554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc155b4-8b21-4d43-9560-004166451fd8 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:16.658259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434e3cb-c70c-47f9-ae15-499bcf7c85fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:16.659151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434e3cb-c70c-47f9-ae15-499bcf7c85fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.659514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434e3cb-c70c-47f9-ae15-499bcf7c85fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.659725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434e3cb-c70c-47f9-ae15-499bcf7c85fb admin admin] PATH_INFO: `/v3/projects/4986327c6fcf4e8e8902dfccd225bb02/users/8dece2c4b0fe416ead2da4bc3b4eee1a/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.675481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434e3cb-c70c-47f9-ae15-499bcf7c85fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4986327c6fcf4e8e8902dfccd225bb02, user_id=8dece2c4b0fe416ead2da4bc3b4eee1a, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:16.678174 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434e3cb-c70c-47f9-ae15-499bcf7c85fb admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:16.699575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1000/1981] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:16 2022] PUT /identity/v3/projects/4986327c6fcf4e8e8902dfccd225bb02/users/8dece2c4b0fe416ead2da4bc3b4eee1a/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:16.703358 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3312127-bd38-47b8-9ebd-15b9cd08e1f4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:16.717066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3312127-bd38-47b8-9ebd-15b9cd08e1f4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:16.808139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d14d55-b99e-4fda-a7fd-1a3f39f45cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:16.808928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d14d55-b99e-4fda-a7fd-1a3f39f45cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.809217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d14d55-b99e-4fda-a7fd-1a3f39f45cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.809500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d14d55-b99e-4fda-a7fd-1a3f39f45cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.810242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d14d55-b99e-4fda-a7fd-1a3f39f45cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:16.812227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d14d55-b99e-4fda-a7fd-1a3f39f45cf8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:16.823972 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 982/1982] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:16.827944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434e3cb-c70c-47f9-ae15-499bcf7c85fb admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:16.838715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434e3cb-c70c-47f9-ae15-499bcf7c85fb admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:16.844054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ecf43-42e0-4a79-9e1f-9fd4cbb7fe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:16.844957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ecf43-42e0-4a79-9e1f-9fd4cbb7fe55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.845245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ecf43-42e0-4a79-9e1f-9fd4cbb7fe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.845522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ecf43-42e0-4a79-9e1f-9fd4cbb7fe55 admin admin] PATH_INFO: `/v3/projects/4986327c6fcf4e8e8902dfccd225bb02/users/8dece2c4b0fe416ead2da4bc3b4eee1a/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.848271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ecf43-42e0-4a79-9e1f-9fd4cbb7fe55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4986327c6fcf4e8e8902dfccd225bb02, user_id=8dece2c4b0fe416ead2da4bc3b4eee1a, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:16.851261 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ecf43-42e0-4a79-9e1f-9fd4cbb7fe55 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:16.864162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1001/1983] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:16 2022] PUT /identity/v3/projects/4986327c6fcf4e8e8902dfccd225bb02/users/8dece2c4b0fe416ead2da4bc3b4eee1a/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:16.875485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f0ac6-a23e-4f18-bd49-5ba79eaff551 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:16.875867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f0ac6-a23e-4f18-bd49-5ba79eaff551 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:16.876225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f0ac6-a23e-4f18-bd49-5ba79eaff551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:16.906819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-009f0ac6-a23e-4f18-bd49-5ba79eaff551 None None] MFA Rules not processed for user `8dece2c4b0fe416ead2da4bc3b4eee1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:16.908032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-009f0ac6-a23e-4f18-bd49-5ba79eaff551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:16.981970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 983/1984] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:16.994202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ecf43-42e0-4a79-9e1f-9fd4cbb7fe55 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:16.996244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e39ecf43-42e0-4a79-9e1f-9fd4cbb7fe55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:17.066934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ecf43-42e0-4a79-9e1f-9fd4cbb7fe55 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:17.070533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb7d5d-57ed-48a7-a92e-35856f9bb712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:17.071250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb7d5d-57ed-48a7-a92e-35856f9bb712 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:17.071480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb7d5d-57ed-48a7-a92e-35856f9bb712 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:17.071759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb7d5d-57ed-48a7-a92e-35856f9bb712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:17.083590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb7d5d-57ed-48a7-a92e-35856f9bb712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:17.085296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb7d5d-57ed-48a7-a92e-35856f9bb712 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:17.091886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:17.098558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1002/1985] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:17.269449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f0ac6-a23e-4f18-bd49-5ba79eaff551 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:17.289760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f0ac6-a23e-4f18-bd49-5ba79eaff551 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:17.297925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bd3ff-4ca5-45db-b052-4024671459b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:17.298928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bd3ff-4ca5-45db-b052-4024671459b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:17.299332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bd3ff-4ca5-45db-b052-4024671459b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:17.299714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bd3ff-4ca5-45db-b052-4024671459b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:17.374525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:17.441506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bd3ff-4ca5-45db-b052-4024671459b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:17.443616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bd3ff-4ca5-45db-b052-4024671459b5 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:17.455682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 984/1986] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:17.850505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb7d5d-57ed-48a7-a92e-35856f9bb712 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:17.916894 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb7d5d-57ed-48a7-a92e-35856f9bb712 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:17.922080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:17.923520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:17.924063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:17.924586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] PATH_INFO: `/v3/users/e67c8970f21041d4ab13e775901b0e73` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:17.926393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67c8970f21041d4ab13e775901b0e73)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:17.928347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:17.986608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67c8970f21041d4ab13e775901b0e73'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:17.987342 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67c8970f21041d4ab13e775901b0e73'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:17.996543 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67c8970f21041d4ab13e775901b0e73'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.010018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67c8970f21041d4ab13e775901b0e73'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.016953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67c8970f21041d4ab13e775901b0e73'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.023941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1003/1987] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:17 2022] DELETE /identity/v3/users/e67c8970f21041d4ab13e775901b0e73 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:18.028562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119760d-fc7c-4c8c-b708-9e83d9b90903 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:18.029033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119760d-fc7c-4c8c-b708-9e83d9b90903 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:18.029167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119760d-fc7c-4c8c-b708-9e83d9b90903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:18.045901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b119760d-fc7c-4c8c-b708-9e83d9b90903 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:18.047127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b119760d-fc7c-4c8c-b708-9e83d9b90903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:18.118385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 985/1988] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:18.127846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:18.129820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:18.188572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19ffdf-8ef3-43eb-9832-2ea839c381fb admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:18.192905 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb70a4d-c202-4274-9aca-cd725501502c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:18.193558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb70a4d-c202-4274-9aca-cd725501502c service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:18.193846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb70a4d-c202-4274-9aca-cd725501502c service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:18.194124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb70a4d-c202-4274-9aca-cd725501502c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:18.204040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb70a4d-c202-4274-9aca-cd725501502c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:18.205490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb70a4d-c202-4274-9aca-cd725501502c service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:18.216848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1004/1989] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:18.564800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119760d-fc7c-4c8c-b708-9e83d9b90903 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:18.566293 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b119760d-fc7c-4c8c-b708-9e83d9b90903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:18.586102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119760d-fc7c-4c8c-b708-9e83d9b90903 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:18.590941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:18.591892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:18.592238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:18.592580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] PATH_INFO: `/v3/projects/6e75ac4d96f44fdba81f8c72fbfbac20` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:18.593969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e75ac4d96f44fdba81f8c72fbfbac20)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:18.595964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:18.652694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e75ac4d96f44fdba81f8c72fbfbac20', 'request_id': 'req-278092c5-af75-462a-838b-374bf1dbda6f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.658089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e75ac4d96f44fdba81f8c72fbfbac20', 'request_id': 'req-278092c5-af75-462a-838b-374bf1dbda6f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.664694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e75ac4d96f44fdba81f8c72fbfbac20', 'request_id': 'req-278092c5-af75-462a-838b-374bf1dbda6f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.676688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] The token cache is being invalidate because project 6e75ac4d96f44fdba81f8c72fbfbac20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:18.677013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.677635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.679217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 986/1990] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:18 2022] DELETE /identity/v3/projects/6e75ac4d96f44fdba81f8c72fbfbac20 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:18.683201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb70a4d-c202-4274-9aca-cd725501502c service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:18.693458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb70a4d-c202-4274-9aca-cd725501502c service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:18.712816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:18.754590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:18.755467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:18.755754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:18.756035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] PATH_INFO: `/v3/users/8dece2c4b0fe416ead2da4bc3b4eee1a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:18.757315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dece2c4b0fe416ead2da4bc3b4eee1a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:18.759301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:18.802965 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dece2c4b0fe416ead2da4bc3b4eee1a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.803608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dece2c4b0fe416ead2da4bc3b4eee1a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.810175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dece2c4b0fe416ead2da4bc3b4eee1a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.822716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dece2c4b0fe416ead2da4bc3b4eee1a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.829570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1cbb1bac-f6f7-4694-a4dc-7be8dca2d14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dece2c4b0fe416ead2da4bc3b4eee1a'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:18.836353 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1005/1991] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:18 2022] DELETE /identity/v3/users/8dece2c4b0fe416ead2da4bc3b4eee1a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:19.119467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:19.121028 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:19.142619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278092c5-af75-462a-838b-374bf1dbda6f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:19.199464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:19.212204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:19.213364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.214169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.215398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] PATH_INFO: `/v3/projects/4986327c6fcf4e8e8902dfccd225bb02` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.217108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4986327c6fcf4e8e8902dfccd225bb02)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:19.219219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:19.280235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4986327c6fcf4e8e8902dfccd225bb02', 'request_id': 'req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:19.286176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4986327c6fcf4e8e8902dfccd225bb02', 'request_id': 'req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:19.293842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4986327c6fcf4e8e8902dfccd225bb02', 'request_id': 'req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:19.310047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] The token cache is being invalidate because project 4986327c6fcf4e8e8902dfccd225bb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:19.310440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:19.311153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-a8a83cd1-0093-47ef-88b8-ca26a2251ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:19.312784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 987/1992] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:19 2022] DELETE /identity/v3/projects/4986327c6fcf4e8e8902dfccd225bb02 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:19.318302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd424bf0-3709-43d8-9e4c-6113dc884f39 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.318799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd424bf0-3709-43d8-9e4c-6113dc884f39 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.319169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd424bf0-3709-43d8-9e4c-6113dc884f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.337837 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dd424bf0-3709-43d8-9e4c-6113dc884f39 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:19.339266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dd424bf0-3709-43d8-9e4c-6113dc884f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:19.409832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1006/1993] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:19.418652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5646-8d63-4fac-9414-57ef3b5291e7 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.418946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5646-8d63-4fac-9414-57ef3b5291e7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.419230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5646-8d63-4fac-9414-57ef3b5291e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.437587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-70fb5646-8d63-4fac-9414-57ef3b5291e7 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:19.438827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-70fb5646-8d63-4fac-9414-57ef3b5291e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:19.447229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 988/1994] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:19.451407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd424bf0-3709-43d8-9e4c-6113dc884f39 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:19.461392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd424bf0-3709-43d8-9e4c-6113dc884f39 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:19.466005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f37ce-44b2-4755-af4f-dea790caf89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:19.466712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f37ce-44b2-4755-af4f-dea790caf89d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.466994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f37ce-44b2-4755-af4f-dea790caf89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.467275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f37ce-44b2-4755-af4f-dea790caf89d admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.467999 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f37ce-44b2-4755-af4f-dea790caf89d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:19.468312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f37ce-44b2-4755-af4f-dea790caf89d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:19.469909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f37ce-44b2-4755-af4f-dea790caf89d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:19.484609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1007/1995] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:19.490943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb5646-8d63-4fac-9414-57ef3b5291e7 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:19.500179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb5646-8d63-4fac-9414-57ef3b5291e7 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:19.504866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd31039-864d-45dc-8055-fad35a25d0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:19.505540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd31039-864d-45dc-8055-fad35a25d0dd admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.505826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd31039-864d-45dc-8055-fad35a25d0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.506103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd31039-864d-45dc-8055-fad35a25d0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.506835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd31039-864d-45dc-8055-fad35a25d0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:19.508849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd31039-864d-45dc-8055-fad35a25d0dd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:19.533138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 989/1996] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:19 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:19.537753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f37ce-44b2-4755-af4f-dea790caf89d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:19.547677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f37ce-44b2-4755-af4f-dea790caf89d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:19.575846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:19.611967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11a397-acba-4c2b-b53f-ab4e9e3fe8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:19.613300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11a397-acba-4c2b-b53f-ab4e9e3fe8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.614099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11a397-acba-4c2b-b53f-ab4e9e3fe8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.614408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11a397-acba-4c2b-b53f-ab4e9e3fe8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.615121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11a397-acba-4c2b-b53f-ab4e9e3fe8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:19.617129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11a397-acba-4c2b-b53f-ab4e9e3fe8f7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:19.637814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1008/1997] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:19 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:19.641930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd31039-864d-45dc-8055-fad35a25d0dd admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:19.652702 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd31039-864d-45dc-8055-fad35a25d0dd admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:19.657415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a7ecf-eceb-4052-a206-0664e3ea010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:19.658080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7ecf-eceb-4052-a206-0664e3ea010a admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.658383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7ecf-eceb-4052-a206-0664e3ea010a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.658664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7ecf-eceb-4052-a206-0664e3ea010a admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.660035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a7ecf-eceb-4052-a206-0664e3ea010a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:19.661502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a7ecf-eceb-4052-a206-0664e3ea010a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:19.673249 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 990/1998] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:19.677828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11a397-acba-4c2b-b53f-ab4e9e3fe8f7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:19.688477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11a397-acba-4c2b-b53f-ab4e9e3fe8f7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:19.693530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d1f74-825a-45b4-a479-b052a1e8e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:19.694299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d1f74-825a-45b4-a479-b052a1e8e94b admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.694687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d1f74-825a-45b4-a479-b052a1e8e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.695040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d1f74-825a-45b4-a479-b052a1e8e94b admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.695850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d1f74-825a-45b4-a479-b052a1e8e94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:19.697706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d1f74-825a-45b4-a479-b052a1e8e94b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:19.710192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1009/1999] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:19.714254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a7ecf-eceb-4052-a206-0664e3ea010a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:19.733485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a7ecf-eceb-4052-a206-0664e3ea010a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:19.739478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f875d-3cec-4a1b-8ddb-6d58e6e45195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:19.740396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f875d-3cec-4a1b-8ddb-6d58e6e45195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.740685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f875d-3cec-4a1b-8ddb-6d58e6e45195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.740964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f875d-3cec-4a1b-8ddb-6d58e6e45195 admin admin] PATH_INFO: `/v3/projects/f23e1937f12845df805cc1813990d288/users/c8315d0d67e2498698d7f8c0ead734b9/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.757675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f875d-3cec-4a1b-8ddb-6d58e6e45195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23e1937f12845df805cc1813990d288, user_id=c8315d0d67e2498698d7f8c0ead734b9, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:19.760602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f875d-3cec-4a1b-8ddb-6d58e6e45195 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:19.785691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 991/2000] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:19 2022] PUT /identity/v3/projects/f23e1937f12845df805cc1813990d288/users/c8315d0d67e2498698d7f8c0ead734b9/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:19.795693 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f5d15-6a67-462b-8d5e-d7d5b85475a8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.795988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f5d15-6a67-462b-8d5e-d7d5b85475a8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.796266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f5d15-6a67-462b-8d5e-d7d5b85475a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.823783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b70f5d15-6a67-462b-8d5e-d7d5b85475a8 None None] MFA Rules not processed for user `c8315d0d67e2498698d7f8c0ead734b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:19.824987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b70f5d15-6a67-462b-8d5e-d7d5b85475a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:19.890046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1010/2001] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:19.902059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f875d-3cec-4a1b-8ddb-6d58e6e45195 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:19.903752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-245f875d-3cec-4a1b-8ddb-6d58e6e45195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:19.962467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f875d-3cec-4a1b-8ddb-6d58e6e45195 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:19.966104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67153385-ca70-4264-b334-0533dfc29b99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:19.966780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153385-ca70-4264-b334-0533dfc29b99 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:19.967064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153385-ca70-4264-b334-0533dfc29b99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:19.967341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153385-ca70-4264-b334-0533dfc29b99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:19.976265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67153385-ca70-4264-b334-0533dfc29b99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:19.977679 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67153385-ca70-4264-b334-0533dfc29b99 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:19.990114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 992/2002] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:20.802992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f5d15-6a67-462b-8d5e-d7d5b85475a8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:20.804403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b70f5d15-6a67-462b-8d5e-d7d5b85475a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:20.884159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f5d15-6a67-462b-8d5e-d7d5b85475a8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:20.888698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:20.889569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:20.889914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:20.890190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] PATH_INFO: `/v3/users/f82bda66eec2431c9206e3ec341c62be` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:20.891497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82bda66eec2431c9206e3ec341c62be)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:20.893526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:20.935396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:20.943158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82bda66eec2431c9206e3ec341c62be'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:20.944038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82bda66eec2431c9206e3ec341c62be'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:20.951411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82bda66eec2431c9206e3ec341c62be'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:20.963730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82bda66eec2431c9206e3ec341c62be'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:20.970783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82bda66eec2431c9206e3ec341c62be'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:20.976684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1011/2003] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:20 2022] DELETE /identity/v3/users/f82bda66eec2431c9206e3ec341c62be => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:20.981338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f7a51-3085-4b54-af13-9dced3896fe6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:20.981807 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f7a51-3085-4b54-af13-9dced3896fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:20.981894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f7a51-3085-4b54-af13-9dced3896fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:20.999272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-cc2f7a51-3085-4b54-af13-9dced3896fe6 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:21.000510 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cc2f7a51-3085-4b54-af13-9dced3896fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:21.017624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:21.061176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 993/2004] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:21.071436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:21.072854 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:21.132768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5221074-b840-4f32-be14-e0d91c87f417 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:21.136339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f7aff-1209-45b0-8822-03b1c2f0b833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:21.136980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7aff-1209-45b0-8822-03b1c2f0b833 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:21.137262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7aff-1209-45b0-8822-03b1c2f0b833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:21.137536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7aff-1209-45b0-8822-03b1c2f0b833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:21.147006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f7aff-1209-45b0-8822-03b1c2f0b833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:21.148432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f7aff-1209-45b0-8822-03b1c2f0b833 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:21.157603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1012/2005] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:21.465680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f7a51-3085-4b54-af13-9dced3896fe6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:21.468458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cc2f7a51-3085-4b54-af13-9dced3896fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:21.489199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f7a51-3085-4b54-af13-9dced3896fe6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:21.498455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:21.501959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:21.502908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:21.504731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] PATH_INFO: `/v3/projects/77e9a9d7df4e4699b50523dcde5cfdf3` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:21.507767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e9a9d7df4e4699b50523dcde5cfdf3)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:21.510158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:21.572257 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e9a9d7df4e4699b50523dcde5cfdf3', 'request_id': 'req-150db1c2-1ec3-445c-98c5-52ed838c5d13'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:21.590253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e9a9d7df4e4699b50523dcde5cfdf3', 'request_id': 'req-150db1c2-1ec3-445c-98c5-52ed838c5d13'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:21.603495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e9a9d7df4e4699b50523dcde5cfdf3', 'request_id': 'req-150db1c2-1ec3-445c-98c5-52ed838c5d13'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:21.618442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] The token cache is being invalidate because project 77e9a9d7df4e4699b50523dcde5cfdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:21.618744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:21.619612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-150db1c2-1ec3-445c-98c5-52ed838c5d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:21.626272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 994/2006] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:21 2022] DELETE /identity/v3/projects/77e9a9d7df4e4699b50523dcde5cfdf3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:21.628554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14314492-4c52-4be3-93d3-6fc5680f926a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:21.629572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14314492-4c52-4be3-93d3-6fc5680f926a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:21.629995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14314492-4c52-4be3-93d3-6fc5680f926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:21.649723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-14314492-4c52-4be3-93d3-6fc5680f926a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:21.650942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-14314492-4c52-4be3-93d3-6fc5680f926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:21.714736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1013/2007] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:21.724224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca33209-ab6d-4b09-a6d1-415874448931 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:21.724522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca33209-ab6d-4b09-a6d1-415874448931 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:21.724805 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca33209-ab6d-4b09-a6d1-415874448931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:21.743985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-aca33209-ab6d-4b09-a6d1-415874448931 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:21.745229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-aca33209-ab6d-4b09-a6d1-415874448931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:21.753508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 995/2008] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:21.757954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14314492-4c52-4be3-93d3-6fc5680f926a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:21.767808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14314492-4c52-4be3-93d3-6fc5680f926a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:21.772539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dff47-40da-499f-9615-d60b42cf67d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:21.773207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dff47-40da-499f-9615-d60b42cf67d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:21.773496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dff47-40da-499f-9615-d60b42cf67d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:21.773774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dff47-40da-499f-9615-d60b42cf67d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:21.774537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dff47-40da-499f-9615-d60b42cf67d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:21.774851 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dff47-40da-499f-9615-d60b42cf67d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:21.776480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dff47-40da-499f-9615-d60b42cf67d4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:21.788626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1014/2009] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:33:21.792886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca33209-ab6d-4b09-a6d1-415874448931 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:21.802611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca33209-ab6d-4b09-a6d1-415874448931 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:21.807225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ee627-1bb7-4002-a7b8-444862c1eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:21.807869 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ee627-1bb7-4002-a7b8-444862c1eff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:21.808155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ee627-1bb7-4002-a7b8-444862c1eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:21.808464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ee627-1bb7-4002-a7b8-444862c1eff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:21.809159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ee627-1bb7-4002-a7b8-444862c1eff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:21.811086 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ee627-1bb7-4002-a7b8-444862c1eff2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:21.835919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 996/2010] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:21 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:21.839849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dff47-40da-499f-9615-d60b42cf67d4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:21.850608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dff47-40da-499f-9615-d60b42cf67d4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:21.896789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:21.914627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91a8dd-3c8b-4b17-b51d-687e0801cd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:21.915255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91a8dd-3c8b-4b17-b51d-687e0801cd5d admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:21.915538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91a8dd-3c8b-4b17-b51d-687e0801cd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:21.915827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91a8dd-3c8b-4b17-b51d-687e0801cd5d admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:21.916501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91a8dd-3c8b-4b17-b51d-687e0801cd5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:21.918387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91a8dd-3c8b-4b17-b51d-687e0801cd5d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:21.938896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1015/2011] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:21 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:21.943098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ee627-1bb7-4002-a7b8-444862c1eff2 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:21.955523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ee627-1bb7-4002-a7b8-444862c1eff2 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:21.960419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5ff6-ef56-4846-8106-85ecad0819d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:21.961158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5ff6-ef56-4846-8106-85ecad0819d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:21.961518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5ff6-ef56-4846-8106-85ecad0819d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:21.961870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5ff6-ef56-4846-8106-85ecad0819d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:21.962711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a5ff6-ef56-4846-8106-85ecad0819d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:21.964384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a5ff6-ef56-4846-8106-85ecad0819d1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:21.975773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 997/2012] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:21.979984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91a8dd-3c8b-4b17-b51d-687e0801cd5d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:21.990902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91a8dd-3c8b-4b17-b51d-687e0801cd5d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:21.995608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf58ff-1c63-4f49-a3bc-6a2a066fc7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:21.996207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf58ff-1c63-4f49-a3bc-6a2a066fc7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:21.996493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf58ff-1c63-4f49-a3bc-6a2a066fc7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:21.996776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf58ff-1c63-4f49-a3bc-6a2a066fc7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:21.997525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf58ff-1c63-4f49-a3bc-6a2a066fc7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:21.999139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf58ff-1c63-4f49-a3bc-6a2a066fc7a4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:22.009386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1016/2013] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:22.013910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5ff6-ef56-4846-8106-85ecad0819d1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:22.024865 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5ff6-ef56-4846-8106-85ecad0819d1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:22.029633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73337e-16a1-4d63-8622-b023ce5eebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:22.030622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73337e-16a1-4d63-8622-b023ce5eebaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:22.030983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73337e-16a1-4d63-8622-b023ce5eebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:22.031352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73337e-16a1-4d63-8622-b023ce5eebaa admin admin] PATH_INFO: `/v3/projects/6154e621887f40cb9c844ac9eb5beeed/users/445c6c39470d4fc3b7c72447effd9c5a/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:22.048097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73337e-16a1-4d63-8622-b023ce5eebaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6154e621887f40cb9c844ac9eb5beeed, user_id=445c6c39470d4fc3b7c72447effd9c5a, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:22.051427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73337e-16a1-4d63-8622-b023ce5eebaa admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:22.065715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 998/2014] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:22 2022] PUT /identity/v3/projects/6154e621887f40cb9c844ac9eb5beeed/users/445c6c39470d4fc3b7c72447effd9c5a/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:22.070811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2da47-30bd-4aba-bcac-9c93d427f87c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:22.071103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2da47-30bd-4aba-bcac-9c93d427f87c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:22.071382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2da47-30bd-4aba-bcac-9c93d427f87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:22.089485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ece2da47-30bd-4aba-bcac-9c93d427f87c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:22.090713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ece2da47-30bd-4aba-bcac-9c93d427f87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:22.148255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1017/2015] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:22.157745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73337e-16a1-4d63-8622-b023ce5eebaa admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:22.160281 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8d73337e-16a1-4d63-8622-b023ce5eebaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:22.205674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:22.219962 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73337e-16a1-4d63-8622-b023ce5eebaa admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:22.224603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660e333-9b52-4fad-b49a-c5f3f02e6525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:22.225247 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e333-9b52-4fad-b49a-c5f3f02e6525 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:22.225531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e333-9b52-4fad-b49a-c5f3f02e6525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:22.225805 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e333-9b52-4fad-b49a-c5f3f02e6525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:22.234764 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660e333-9b52-4fad-b49a-c5f3f02e6525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:22.236427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660e333-9b52-4fad-b49a-c5f3f02e6525 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:22.245944 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 999/2016] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:27.259678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2da47-30bd-4aba-bcac-9c93d427f87c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:27.261194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ece2da47-30bd-4aba-bcac-9c93d427f87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:27.277311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2da47-30bd-4aba-bcac-9c93d427f87c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:27.289538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:27.291023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:27.291487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:27.291918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] PATH_INFO: `/v3/users/14aa838cc2c84308951dfe8da868b589` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:27.294142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14aa838cc2c84308951dfe8da868b589)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:27.297538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:27.382445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14aa838cc2c84308951dfe8da868b589'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:27.384853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14aa838cc2c84308951dfe8da868b589'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:27.404009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14aa838cc2c84308951dfe8da868b589'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:27.433781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14aa838cc2c84308951dfe8da868b589'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:27.450299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14aa838cc2c84308951dfe8da868b589'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:27.459874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1018/2017] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:27 2022] DELETE /identity/v3/users/14aa838cc2c84308951dfe8da868b589 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:27.464060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3293353-fc07-482c-8910-1163d2d5e460 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:27.464570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3293353-fc07-482c-8910-1163d2d5e460 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:27.464658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3293353-fc07-482c-8910-1163d2d5e460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:27.528972 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d3293353-fc07-482c-8910-1163d2d5e460 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:27.530295 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d3293353-fc07-482c-8910-1163d2d5e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:27.725187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1000/2018] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:27.763069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:27.766071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:27.834445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:27.875047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3114f07-e1b5-4273-92b3-2b886c02ed1f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:27.880362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0274b-eb91-4598-b449-c07fec6c993d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:27.881028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0274b-eb91-4598-b449-c07fec6c993d service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:27.881624 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0274b-eb91-4598-b449-c07fec6c993d service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:27.881957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0274b-eb91-4598-b449-c07fec6c993d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:27.895473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0274b-eb91-4598-b449-c07fec6c993d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:27.897231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0274b-eb91-4598-b449-c07fec6c993d service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:27.923502 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1019/2019] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:28.384820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3293353-fc07-482c-8910-1163d2d5e460 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:28.386536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d3293353-fc07-482c-8910-1163d2d5e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:28.401660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3293353-fc07-482c-8910-1163d2d5e460 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:28.407403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:28.408808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:28.409837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:28.410839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] PATH_INFO: `/v3/projects/b63e9a592cce426a911c8fd03474049c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:28.412276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63e9a592cce426a911c8fd03474049c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:28.415064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:28.466986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63e9a592cce426a911c8fd03474049c', 'request_id': 'req-106eea87-3c53-4817-812f-5dbd9f143ec7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:28.473983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63e9a592cce426a911c8fd03474049c', 'request_id': 'req-106eea87-3c53-4817-812f-5dbd9f143ec7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:28.481227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63e9a592cce426a911c8fd03474049c', 'request_id': 'req-106eea87-3c53-4817-812f-5dbd9f143ec7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:28.497706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] The token cache is being invalidate because project b63e9a592cce426a911c8fd03474049c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:28.498319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:28.498995 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-106eea87-3c53-4817-812f-5dbd9f143ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:28.501592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1001/2020] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:28 2022] DELETE /identity/v3/projects/b63e9a592cce426a911c8fd03474049c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:28.506925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a111-b487-471d-825d-772a6fd5f1e3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:28.507427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a111-b487-471d-825d-772a6fd5f1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:28.507629 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a111-b487-471d-825d-772a6fd5f1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:28.536190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2c92a111-b487-471d-825d-772a6fd5f1e3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:28.537791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2c92a111-b487-471d-825d-772a6fd5f1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:28.624229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1020/2021] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:28.634456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c469-8767-4484-82dc-7effb091a0e1 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:28.634976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c469-8767-4484-82dc-7effb091a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:28.635424 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302c469-8767-4484-82dc-7effb091a0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:28.655654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4302c469-8767-4484-82dc-7effb091a0e1 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:28.656909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4302c469-8767-4484-82dc-7effb091a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:28.669875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1002/2022] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:28.671285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a111-b487-471d-825d-772a6fd5f1e3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:28.681737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a111-b487-471d-825d-772a6fd5f1e3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:28.686590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954354d-a87a-4433-a2fa-8167de69917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:28.687272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954354d-a87a-4433-a2fa-8167de69917a admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:28.687558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954354d-a87a-4433-a2fa-8167de69917a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:28.687850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954354d-a87a-4433-a2fa-8167de69917a admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:28.688601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954354d-a87a-4433-a2fa-8167de69917a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:28.688916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954354d-a87a-4433-a2fa-8167de69917a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:28.691260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954354d-a87a-4433-a2fa-8167de69917a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:28.704512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1021/2023] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:28.709464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302c469-8767-4484-82dc-7effb091a0e1 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:28.720583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302c469-8767-4484-82dc-7effb091a0e1 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:28.727726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab233a-78dc-4b95-9cc7-b9ea5433aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:28.728471 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab233a-78dc-4b95-9cc7-b9ea5433aabc admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:28.728854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab233a-78dc-4b95-9cc7-b9ea5433aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:28.729223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab233a-78dc-4b95-9cc7-b9ea5433aabc admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:28.730063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab233a-78dc-4b95-9cc7-b9ea5433aabc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:28.732131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab233a-78dc-4b95-9cc7-b9ea5433aabc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:28.761945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1003/2024] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:28 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:28.766554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954354d-a87a-4433-a2fa-8167de69917a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:28.777408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954354d-a87a-4433-a2fa-8167de69917a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:28.854594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078dcf7-c8bc-4b70-b5ce-3a092063929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:28.855473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078dcf7-c8bc-4b70-b5ce-3a092063929d admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:28.855867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078dcf7-c8bc-4b70-b5ce-3a092063929d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:28.856341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078dcf7-c8bc-4b70-b5ce-3a092063929d admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:28.857162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078dcf7-c8bc-4b70-b5ce-3a092063929d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:28.859245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078dcf7-c8bc-4b70-b5ce-3a092063929d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:28.886102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1022/2025] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:28 2022] POST /identity/v3/users => generated 279 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:28.887835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab233a-78dc-4b95-9cc7-b9ea5433aabc admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:28.903407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab233a-78dc-4b95-9cc7-b9ea5433aabc admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:28.908818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbaf9e-3f11-4e4d-95f2-e3cc221c9df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:28.909528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbaf9e-3f11-4e4d-95f2-e3cc221c9df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:28.909960 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbaf9e-3f11-4e4d-95f2-e3cc221c9df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:28.910416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbaf9e-3f11-4e4d-95f2-e3cc221c9df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:28.911301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbaf9e-3f11-4e4d-95f2-e3cc221c9df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:28.913214 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbaf9e-3f11-4e4d-95f2-e3cc221c9df6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:28.929355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1004/2026] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:28.933444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078dcf7-c8bc-4b70-b5ce-3a092063929d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:28.945068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078dcf7-c8bc-4b70-b5ce-3a092063929d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:28.950036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4976873-b1d2-4bcf-b31c-060b27a6fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:28.950874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4976873-b1d2-4bcf-b31c-060b27a6fda2 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:28.951268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4976873-b1d2-4bcf-b31c-060b27a6fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:28.951649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4976873-b1d2-4bcf-b31c-060b27a6fda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:28.952546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4976873-b1d2-4bcf-b31c-060b27a6fda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:28.954280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4976873-b1d2-4bcf-b31c-060b27a6fda2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:28.967592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1023/2027] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:28.971798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbaf9e-3f11-4e4d-95f2-e3cc221c9df6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:28.983000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbaf9e-3f11-4e4d-95f2-e3cc221c9df6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:28.999479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044ddbf-faad-4048-af03-969dc2df0536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:29.000863 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044ddbf-faad-4048-af03-969dc2df0536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:29.001150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044ddbf-faad-4048-af03-969dc2df0536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:29.001430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044ddbf-faad-4048-af03-969dc2df0536 admin admin] PATH_INFO: `/v3/projects/6cf50901ad534ca99f314a0602707105/users/49d706661bce4dff922edead22eb0d4f/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:29.035535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044ddbf-faad-4048-af03-969dc2df0536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf50901ad534ca99f314a0602707105, user_id=49d706661bce4dff922edead22eb0d4f, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:29.039876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044ddbf-faad-4048-af03-969dc2df0536 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:29.075546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1005/2028] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:28 2022] PUT /identity/v3/projects/6cf50901ad534ca99f314a0602707105/users/49d706661bce4dff922edead22eb0d4f/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:29.078405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca235-211f-4bb6-b584-ece15eae8b0e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:29.078711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca235-211f-4bb6-b584-ece15eae8b0e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:29.079415 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca235-211f-4bb6-b584-ece15eae8b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:29.122144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acdc03-109c-41f4-a634-b4b750dd13ab None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:29.122641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acdc03-109c-41f4-a634-b4b750dd13ab None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:29.122921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acdc03-109c-41f4-a634-b4b750dd13ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:29.133215 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:29.141820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-494ca235-211f-4bb6-b584-ece15eae8b0e None None] MFA Rules not processed for user `49d706661bce4dff922edead22eb0d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:29.143522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-494ca235-211f-4bb6-b584-ece15eae8b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:29.170258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-06acdc03-109c-41f4-a634-b4b750dd13ab None None] MFA Rules not processed for user `445c6c39470d4fc3b7c72447effd9c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:29.171541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-06acdc03-109c-41f4-a634-b4b750dd13ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:29.187306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:29.271173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1006/2029] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:29.272130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1024/2030] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:29.276194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acdc03-109c-41f4-a634-b4b750dd13ab None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:29.277817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-06acdc03-109c-41f4-a634-b4b750dd13ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:29.326848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ca235-211f-4bb6-b584-ece15eae8b0e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:29.328673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-494ca235-211f-4bb6-b584-ece15eae8b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:29.364162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acdc03-109c-41f4-a634-b4b750dd13ab None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:29.370976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14715d-831d-489f-92ac-acaf20c253c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:29.371727 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14715d-831d-489f-92ac-acaf20c253c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:29.372120 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14715d-831d-489f-92ac-acaf20c253c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:29.372525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14715d-831d-489f-92ac-acaf20c253c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:29.373328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14715d-831d-489f-92ac-acaf20c253c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:29.376031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14715d-831d-489f-92ac-acaf20c253c1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:29.416838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1007/2031] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:29 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:29.418755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ca235-211f-4bb6-b584-ece15eae8b0e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:29.419768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14715d-831d-489f-92ac-acaf20c253c1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:29.508842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14715d-831d-489f-92ac-acaf20c253c1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:29.512289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a43ac-4ffa-4420-9254-948e54896bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:29.512937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a43ac-4ffa-4420-9254-948e54896bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:29.513303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a43ac-4ffa-4420-9254-948e54896bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:29.513679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a43ac-4ffa-4420-9254-948e54896bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:29.515207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40f8fa-4129-4a42-a136-99d42e5ba4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:29.516447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40f8fa-4129-4a42-a136-99d42e5ba4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:29.516447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40f8fa-4129-4a42-a136-99d42e5ba4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:29.516858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40f8fa-4129-4a42-a136-99d42e5ba4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:29.518179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40f8fa-4129-4a42-a136-99d42e5ba4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:29.520638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40f8fa-4129-4a42-a136-99d42e5ba4b7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:29.601278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1008/2032] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:29 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:33:29.605491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40f8fa-4129-4a42-a136-99d42e5ba4b7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:29.632508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40f8fa-4129-4a42-a136-99d42e5ba4b7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:29.647129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5af648-7b96-45d5-bba2-1cd73d6c1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:29.649140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5af648-7b96-45d5-bba2-1cd73d6c1d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:29.649784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5af648-7b96-45d5-bba2-1cd73d6c1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:29.650818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5af648-7b96-45d5-bba2-1cd73d6c1d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:29.652103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5af648-7b96-45d5-bba2-1cd73d6c1d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:29.654339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5af648-7b96-45d5-bba2-1cd73d6c1d6e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:29.659227 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a43ac-4ffa-4420-9254-948e54896bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:29.662601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a43ac-4ffa-4420-9254-948e54896bd6 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:29.666319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:29.698243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1009/2033] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:29.699471 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5af648-7b96-45d5-bba2-1cd73d6c1d6e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:29.708847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1025/2034] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:29 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:29.725310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5af648-7b96-45d5-bba2-1cd73d6c1d6e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:29.726346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a43ac-4ffa-4420-9254-948e54896bd6 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:29.732066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3a738-a076-483a-b8e5-6d4a99d029c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:29.733364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3a738-a076-483a-b8e5-6d4a99d029c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:29.733855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3a738-a076-483a-b8e5-6d4a99d029c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:29.734282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3a738-a076-483a-b8e5-6d4a99d029c9 admin admin] PATH_INFO: `/v3/projects/28fb076a0c3a49a0a9baf49f724c145c/users/1259a413fdb7499ab01e89475c3d4369/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:29.741720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a43ac-4ffa-4420-9254-948e54896bd6 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:29.756562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3a738-a076-483a-b8e5-6d4a99d029c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28fb076a0c3a49a0a9baf49f724c145c, user_id=1259a413fdb7499ab01e89475c3d4369, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:29.767059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:29.774696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:29.775017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:29.777611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] PATH_INFO: `/v3/users/49d706661bce4dff922edead22eb0d4f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:29.782754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3a738-a076-483a-b8e5-6d4a99d029c9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:29.783675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d706661bce4dff922edead22eb0d4f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:29.794024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:29.820697 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1010/2035] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:29 2022] PUT /identity/v3/projects/28fb076a0c3a49a0a9baf49f724c145c/users/1259a413fdb7499ab01e89475c3d4369/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:29.825168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3a738-a076-483a-b8e5-6d4a99d029c9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:29.913844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:29.921861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d706661bce4dff922edead22eb0d4f'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:29.922665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d706661bce4dff922edead22eb0d4f'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:29.937726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d706661bce4dff922edead22eb0d4f'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:29.958774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d706661bce4dff922edead22eb0d4f'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:29.960787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3a738-a076-483a-b8e5-6d4a99d029c9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:29.966794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05e1d3-37e5-45e1-8ee5-c40350601592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:29.967987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05e1d3-37e5-45e1-8ee5-c40350601592 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:29.967987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05e1d3-37e5-45e1-8ee5-c40350601592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:29.968252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05e1d3-37e5-45e1-8ee5-c40350601592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:29.968950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05e1d3-37e5-45e1-8ee5-c40350601592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:29.970744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05e1d3-37e5-45e1-8ee5-c40350601592 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:29.979305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b71fce2b-3b5d-406d-8b57-15dbe469bd32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d706661bce4dff922edead22eb0d4f'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:29.995410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1011/2036] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:29.996652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05e1d3-37e5-45e1-8ee5-c40350601592 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:29.998759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7f05e1d3-37e5-45e1-8ee5-c40350601592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:30.002803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1026/2037] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:29 2022] DELETE /identity/v3/users/49d706661bce4dff922edead22eb0d4f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:30.006123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a042ad-33c4-412b-ae4a-da352ee8af00 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:30.006330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a042ad-33c4-412b-ae4a-da352ee8af00 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:30.006760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a042ad-33c4-412b-ae4a-da352ee8af00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:30.018722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05e1d3-37e5-45e1-8ee5-c40350601592 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:30.035104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e2a042ad-33c4-412b-ae4a-da352ee8af00 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:30.036447 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e2a042ad-33c4-412b-ae4a-da352ee8af00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:30.094192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614932-8be8-43a6-8bd8-78f8c35def83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:30.095598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614932-8be8-43a6-8bd8-78f8c35def83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:30.097755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614932-8be8-43a6-8bd8-78f8c35def83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:30.098076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614932-8be8-43a6-8bd8-78f8c35def83 admin admin] PATH_INFO: `/v3/projects/28fb076a0c3a49a0a9baf49f724c145c/users/1259a413fdb7499ab01e89475c3d4369/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:30.100870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec614932-8be8-43a6-8bd8-78f8c35def83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28fb076a0c3a49a0a9baf49f724c145c, user_id=1259a413fdb7499ab01e89475c3d4369, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:30.105251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec614932-8be8-43a6-8bd8-78f8c35def83 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:30.114982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1027/2038] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:30.118393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1012/2039] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:29 2022] PUT /identity/v3/projects/28fb076a0c3a49a0a9baf49f724c145c/users/1259a413fdb7499ab01e89475c3d4369/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:30.125546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a042ad-33c4-412b-ae4a-da352ee8af00 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:30.127175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e2a042ad-33c4-412b-ae4a-da352ee8af00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:30.202546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a042ad-33c4-412b-ae4a-da352ee8af00 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:30.273880 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330629c7-8353-438b-929b-98dc95d65343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:30.274673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330629c7-8353-438b-929b-98dc95d65343 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:30.274857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330629c7-8353-438b-929b-98dc95d65343 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:30.275151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330629c7-8353-438b-929b-98dc95d65343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:30.308800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:30.349256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330629c7-8353-438b-929b-98dc95d65343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:30.352801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330629c7-8353-438b-929b-98dc95d65343 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:30.380408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1028/2040] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:30.843162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614932-8be8-43a6-8bd8-78f8c35def83 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:30.851627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ec614932-8be8-43a6-8bd8-78f8c35def83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:30.883513 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614932-8be8-43a6-8bd8-78f8c35def83 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:30.907452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:30.908106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:30.908319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:30.908596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] PATH_INFO: `/v3/projects/6cf50901ad534ca99f314a0602707105` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:30.910555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf50901ad534ca99f314a0602707105)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:30.919528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:31.029945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf50901ad534ca99f314a0602707105', 'request_id': 'req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:31.045937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf50901ad534ca99f314a0602707105', 'request_id': 'req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:31.047559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:31.056252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf50901ad534ca99f314a0602707105', 'request_id': 'req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:31.076160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] The token cache is being invalidate because project 6cf50901ad534ca99f314a0602707105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:31.076446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:31.077838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cdbb9eb3-b4c1-4e6d-bbd9-49c92f68d781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:31.080415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1013/2041] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:30 2022] DELETE /identity/v3/projects/6cf50901ad534ca99f314a0602707105 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:31.086020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f804-ef6e-4bfd-831c-062574b3f718 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:31.086568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f804-ef6e-4bfd-831c-062574b3f718 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:31.086681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f804-ef6e-4bfd-831c-062574b3f718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:31.118669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-74c0f804-ef6e-4bfd-831c-062574b3f718 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:31.119935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-74c0f804-ef6e-4bfd-831c-062574b3f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:31.275437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1029/2042] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:31.277909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06516d9f-5afb-4479-9340-0ac22c6f977e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:31.278370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06516d9f-5afb-4479-9340-0ac22c6f977e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:31.278797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06516d9f-5afb-4479-9340-0ac22c6f977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:31.321257 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-06516d9f-5afb-4479-9340-0ac22c6f977e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:31.323370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-06516d9f-5afb-4479-9340-0ac22c6f977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:31.335206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1014/2043] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:31.339027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f804-ef6e-4bfd-831c-062574b3f718 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:31.366181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f804-ef6e-4bfd-831c-062574b3f718 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:31.371009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911f0fb-ff2b-4846-9d7f-0ef5a106e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:31.371678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911f0fb-ff2b-4846-9d7f-0ef5a106e35d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:31.372848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911f0fb-ff2b-4846-9d7f-0ef5a106e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:31.373137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911f0fb-ff2b-4846-9d7f-0ef5a106e35d admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:31.373896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911f0fb-ff2b-4846-9d7f-0ef5a106e35d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:31.374213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911f0fb-ff2b-4846-9d7f-0ef5a106e35d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:31.375875 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911f0fb-ff2b-4846-9d7f-0ef5a106e35d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:31.425844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1030/2044] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:31.430324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06516d9f-5afb-4479-9340-0ac22c6f977e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:31.448136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06516d9f-5afb-4479-9340-0ac22c6f977e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:31.462663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356c0b-199f-485d-bf34-51b2da47655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:31.463756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356c0b-199f-485d-bf34-51b2da47655e admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:31.464428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356c0b-199f-485d-bf34-51b2da47655e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:31.464898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356c0b-199f-485d-bf34-51b2da47655e admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:31.465837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38356c0b-199f-485d-bf34-51b2da47655e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:31.474416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38356c0b-199f-485d-bf34-51b2da47655e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:31.539256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1015/2045] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:31 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:31.543233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911f0fb-ff2b-4846-9d7f-0ef5a106e35d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:31.555605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911f0fb-ff2b-4846-9d7f-0ef5a106e35d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:31.668590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587716-af02-4497-9589-9ce6bc85e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:31.669666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587716-af02-4497-9589-9ce6bc85e371 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:31.670037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587716-af02-4497-9589-9ce6bc85e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:31.671232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587716-af02-4497-9589-9ce6bc85e371 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:31.671354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0587716-af02-4497-9589-9ce6bc85e371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:31.673367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0587716-af02-4497-9589-9ce6bc85e371 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:31.715430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356c0b-199f-485d-bf34-51b2da47655e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:31.722370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1031/2046] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:31 2022] POST /identity/v3/users => generated 283 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:31.727733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356c0b-199f-485d-bf34-51b2da47655e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:31.734723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d673094-ba5f-41e7-a890-11f5fb0ac887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:31.735651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d673094-ba5f-41e7-a890-11f5fb0ac887 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:31.736167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d673094-ba5f-41e7-a890-11f5fb0ac887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:31.736847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d673094-ba5f-41e7-a890-11f5fb0ac887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:31.737708 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d673094-ba5f-41e7-a890-11f5fb0ac887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:31.740455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d673094-ba5f-41e7-a890-11f5fb0ac887 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:31.754394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1016/2047] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:31.758338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587716-af02-4497-9589-9ce6bc85e371 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:31.786649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587716-af02-4497-9589-9ce6bc85e371 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:31.792833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6055260-7d21-447b-b2c9-a02c13352e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:31.794072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6055260-7d21-447b-b2c9-a02c13352e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:31.795166 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6055260-7d21-447b-b2c9-a02c13352e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:31.795637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6055260-7d21-447b-b2c9-a02c13352e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:31.796974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6055260-7d21-447b-b2c9-a02c13352e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:31.799437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6055260-7d21-447b-b2c9-a02c13352e54 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:31.829950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d673094-ba5f-41e7-a890-11f5fb0ac887 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:31.838615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1032/2048] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:31.845864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d673094-ba5f-41e7-a890-11f5fb0ac887 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:31.860070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520128b-ef3d-4cf6-ae32-109f23923910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:31.861187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520128b-ef3d-4cf6-ae32-109f23923910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:31.862111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520128b-ef3d-4cf6-ae32-109f23923910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:31.863398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520128b-ef3d-4cf6-ae32-109f23923910 admin admin] PATH_INFO: `/v3/projects/642028e2f4a34165a99b3411c2788f76/users/0d6f99cfc1624f489251c0d0e72fdd29/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:31.895222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520128b-ef3d-4cf6-ae32-109f23923910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=642028e2f4a34165a99b3411c2788f76, user_id=0d6f99cfc1624f489251c0d0e72fdd29, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:31.898488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520128b-ef3d-4cf6-ae32-109f23923910 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:31.927051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1017/2049] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:31 2022] PUT /identity/v3/projects/642028e2f4a34165a99b3411c2788f76/users/0d6f99cfc1624f489251c0d0e72fdd29/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:31.938155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0ba75-821a-4cca-8515-2a5ecb87ff27 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:31.939400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0ba75-821a-4cca-8515-2a5ecb87ff27 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:31.939794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0ba75-821a-4cca-8515-2a5ecb87ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:32.045670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ddf0ba75-821a-4cca-8515-2a5ecb87ff27 None None] MFA Rules not processed for user `0d6f99cfc1624f489251c0d0e72fdd29`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:32.046973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ddf0ba75-821a-4cca-8515-2a5ecb87ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:32.122400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:32.251083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1033/2050] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:32.260290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520128b-ef3d-4cf6-ae32-109f23923910 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:32.262290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0520128b-ef3d-4cf6-ae32-109f23923910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:32.393133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520128b-ef3d-4cf6-ae32-109f23923910 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:32.404056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fb91a-6534-4eb6-a0ea-570e7e6d9d08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:32.404929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb91a-6534-4eb6-a0ea-570e7e6d9d08 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:32.407157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb91a-6534-4eb6-a0ea-570e7e6d9d08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:32.407157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb91a-6534-4eb6-a0ea-570e7e6d9d08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:32.418516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fb91a-6534-4eb6-a0ea-570e7e6d9d08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:32.420342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fb91a-6534-4eb6-a0ea-570e7e6d9d08 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:32.440612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1018/2051] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:35.036146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0ba75-821a-4cca-8515-2a5ecb87ff27 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:35.038131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ddf0ba75-821a-4cca-8515-2a5ecb87ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:35.156409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0ba75-821a-4cca-8515-2a5ecb87ff27 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:35.164745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:35.165916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:35.172346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:35.173328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] PATH_INFO: `/v3/users/c8315d0d67e2498698d7f8c0ead734b9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:35.175596 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8315d0d67e2498698d7f8c0ead734b9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:35.177516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:35.250150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8315d0d67e2498698d7f8c0ead734b9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:35.251219 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8315d0d67e2498698d7f8c0ead734b9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:35.263226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8315d0d67e2498698d7f8c0ead734b9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:35.278290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8315d0d67e2498698d7f8c0ead734b9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:35.287336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8315d0d67e2498698d7f8c0ead734b9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:35.294477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1034/2052] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:35 2022] DELETE /identity/v3/users/c8315d0d67e2498698d7f8c0ead734b9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:35.299240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb085c-70cf-46a1-8115-193f8208cd7b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:35.299793 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb085c-70cf-46a1-8115-193f8208cd7b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:35.299908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb085c-70cf-46a1-8115-193f8208cd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:35.327540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e0bb085c-70cf-46a1-8115-193f8208cd7b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:35.328834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e0bb085c-70cf-46a1-8115-193f8208cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:35.432158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1019/2053] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:35.483820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:35.485904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:35.600252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:35.638622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489289ef-05aa-4684-a778-16c9ae11c28d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:35.655981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89725033-fd36-4f8b-a39b-f9dc4625a3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:35.658152 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725033-fd36-4f8b-a39b-f9dc4625a3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:35.658700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725033-fd36-4f8b-a39b-f9dc4625a3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:35.660690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725033-fd36-4f8b-a39b-f9dc4625a3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:35.700913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89725033-fd36-4f8b-a39b-f9dc4625a3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:35.702995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89725033-fd36-4f8b-a39b-f9dc4625a3a6 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:35.719774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1035/2054] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:36.704958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb085c-70cf-46a1-8115-193f8208cd7b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:36.708606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e0bb085c-70cf-46a1-8115-193f8208cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:36.728875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb085c-70cf-46a1-8115-193f8208cd7b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:36.747095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:36.749361 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:36.749874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:36.750325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] PATH_INFO: `/v3/projects/f23e1937f12845df805cc1813990d288` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:36.752144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23e1937f12845df805cc1813990d288)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:36.754276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:36.790621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:36.828341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23e1937f12845df805cc1813990d288', 'request_id': 'req-1791ce40-2dd8-4da9-817c-7b66caa86b21'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:36.840228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23e1937f12845df805cc1813990d288', 'request_id': 'req-1791ce40-2dd8-4da9-817c-7b66caa86b21'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:36.858420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23e1937f12845df805cc1813990d288', 'request_id': 'req-1791ce40-2dd8-4da9-817c-7b66caa86b21'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:36.886324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] The token cache is being invalidate because project f23e1937f12845df805cc1813990d288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:36.886624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:36.888135 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1791ce40-2dd8-4da9-817c-7b66caa86b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:36.897937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1020/2055] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:36 2022] DELETE /identity/v3/projects/f23e1937f12845df805cc1813990d288 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:36.902919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e97d-1619-46b7-a648-53168998327e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:36.903819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e97d-1619-46b7-a648-53168998327e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:36.904282 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2e97d-1619-46b7-a648-53168998327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:36.935009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-8bf2e97d-1619-46b7-a648-53168998327e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:36.939105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8bf2e97d-1619-46b7-a648-53168998327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:37.052976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1036/2056] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:37.060933 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcabd9-4b08-42f0-a1f4-971abfb828cd None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:37.061653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcabd9-4b08-42f0-a1f4-971abfb828cd None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:37.061653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcabd9-4b08-42f0-a1f4-971abfb828cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:37.094222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1ebcabd9-4b08-42f0-a1f4-971abfb828cd None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:37.097501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1ebcabd9-4b08-42f0-a1f4-971abfb828cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:37.108616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1021/2057] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:37.113311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2e97d-1619-46b7-a648-53168998327e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:37.135075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2e97d-1619-46b7-a648-53168998327e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:37.143440 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116e69e-5d17-4c1c-a242-6bcb15562e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:37.144980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116e69e-5d17-4c1c-a242-6bcb15562e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:37.145313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116e69e-5d17-4c1c-a242-6bcb15562e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:37.145536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116e69e-5d17-4c1c-a242-6bcb15562e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:37.146555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116e69e-5d17-4c1c-a242-6bcb15562e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:37.146666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116e69e-5d17-4c1c-a242-6bcb15562e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:37.149593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116e69e-5d17-4c1c-a242-6bcb15562e1e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:37.172323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1037/2058] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:37.173550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcabd9-4b08-42f0-a1f4-971abfb828cd None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:37.185905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcabd9-4b08-42f0-a1f4-971abfb828cd None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:37.191598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666af7f-8c36-4d6b-94bc-123f164f37bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:37.193495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666af7f-8c36-4d6b-94bc-123f164f37bb admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:37.194002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666af7f-8c36-4d6b-94bc-123f164f37bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:37.195190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666af7f-8c36-4d6b-94bc-123f164f37bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:37.196123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666af7f-8c36-4d6b-94bc-123f164f37bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:37.206757 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666af7f-8c36-4d6b-94bc-123f164f37bb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:37.254721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1022/2059] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:37 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:37.255618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116e69e-5d17-4c1c-a242-6bcb15562e1e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:37.266477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116e69e-5d17-4c1c-a242-6bcb15562e1e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:37.387522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e595e-c686-4f4e-a37a-85c049d5d552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:37.389084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e595e-c686-4f4e-a37a-85c049d5d552 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:37.389883 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e595e-c686-4f4e-a37a-85c049d5d552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:37.390402 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e595e-c686-4f4e-a37a-85c049d5d552 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:37.391972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e595e-c686-4f4e-a37a-85c049d5d552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:37.396577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e595e-c686-4f4e-a37a-85c049d5d552 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:37.428953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1038/2060] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:37 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:33:37.432693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666af7f-8c36-4d6b-94bc-123f164f37bb admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:37.462565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666af7f-8c36-4d6b-94bc-123f164f37bb admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:37.480285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbebef1-000c-4c83-b313-44404e7b8468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:37.481166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbebef1-000c-4c83-b313-44404e7b8468 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:37.481559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbebef1-000c-4c83-b313-44404e7b8468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:37.481938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbebef1-000c-4c83-b313-44404e7b8468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:37.483316 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbebef1-000c-4c83-b313-44404e7b8468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:37.485047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbebef1-000c-4c83-b313-44404e7b8468 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:37.539357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1023/2061] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:37.543318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e595e-c686-4f4e-a37a-85c049d5d552 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:37.559102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e595e-c686-4f4e-a37a-85c049d5d552 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:37.576505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cddac-2596-4894-bc39-2cf03fc7c158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:37.577812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cddac-2596-4894-bc39-2cf03fc7c158 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:37.578097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cddac-2596-4894-bc39-2cf03fc7c158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:37.579002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cddac-2596-4894-bc39-2cf03fc7c158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:37.579745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cddac-2596-4894-bc39-2cf03fc7c158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:37.582925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cddac-2596-4894-bc39-2cf03fc7c158 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:37.609055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbebef1-000c-4c83-b313-44404e7b8468 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:37.613718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1039/2062] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:37.624036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbebef1-000c-4c83-b313-44404e7b8468 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:37.635250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db4666-8f28-4c1b-a8b3-c9168ef19e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:37.638229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db4666-8f28-4c1b-a8b3-c9168ef19e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:37.638724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db4666-8f28-4c1b-a8b3-c9168ef19e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:37.639018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db4666-8f28-4c1b-a8b3-c9168ef19e86 admin admin] PATH_INFO: `/v3/projects/69e88777ab664665af8d076206655acd/users/038a091689b9402194712a76c450ce06/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:37.660594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db4666-8f28-4c1b-a8b3-c9168ef19e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e88777ab664665af8d076206655acd, user_id=038a091689b9402194712a76c450ce06, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:37.670048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db4666-8f28-4c1b-a8b3-c9168ef19e86 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:37.713667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1024/2063] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:37 2022] PUT /identity/v3/projects/69e88777ab664665af8d076206655acd/users/038a091689b9402194712a76c450ce06/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:37.725589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8fe9b-bde9-48a9-b35f-803f805ad9f2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:37.725879 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8fe9b-bde9-48a9-b35f-803f805ad9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:37.726167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8fe9b-bde9-48a9-b35f-803f805ad9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:37.760034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d4c8fe9b-bde9-48a9-b35f-803f805ad9f2 None None] MFA Rules not processed for user `038a091689b9402194712a76c450ce06`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:37.761380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d4c8fe9b-bde9-48a9-b35f-803f805ad9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:37.830006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:37.908561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1040/2064] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:37.913949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db4666-8f28-4c1b-a8b3-c9168ef19e86 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:38.071678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db4666-8f28-4c1b-a8b3-c9168ef19e86 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:38.097363 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870c2e3-d53a-4957-bd83-5a00984942b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:38.098078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870c2e3-d53a-4957-bd83-5a00984942b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:38.098383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870c2e3-d53a-4957-bd83-5a00984942b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:38.098667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870c2e3-d53a-4957-bd83-5a00984942b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:38.099379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870c2e3-d53a-4957-bd83-5a00984942b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:38.101344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870c2e3-d53a-4957-bd83-5a00984942b5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:38.157150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1025/2065] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:37 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:38.160830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8fe9b-bde9-48a9-b35f-803f805ad9f2 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:38.180573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8fe9b-bde9-48a9-b35f-803f805ad9f2 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:38.285356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff440c-4938-45ff-9ebe-fa92cfdd9764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:38.286742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff440c-4938-45ff-9ebe-fa92cfdd9764 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:38.287816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff440c-4938-45ff-9ebe-fa92cfdd9764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:38.288181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff440c-4938-45ff-9ebe-fa92cfdd9764 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:38.289452 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff440c-4938-45ff-9ebe-fa92cfdd9764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:38.292124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff440c-4938-45ff-9ebe-fa92cfdd9764 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:38.326205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1041/2066] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:38 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:38.327521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870c2e3-d53a-4957-bd83-5a00984942b5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:38.341127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870c2e3-d53a-4957-bd83-5a00984942b5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:38.356305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ed913-bfec-4e99-b9e2-104002faa347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:38.359095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ed913-bfec-4e99-b9e2-104002faa347 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:38.359403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ed913-bfec-4e99-b9e2-104002faa347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:38.359684 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ed913-bfec-4e99-b9e2-104002faa347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:38.360450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ed913-bfec-4e99-b9e2-104002faa347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:38.362923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ed913-bfec-4e99-b9e2-104002faa347 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:38.379595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1026/2067] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:38.383724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff440c-4938-45ff-9ebe-fa92cfdd9764 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:38.398177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff440c-4938-45ff-9ebe-fa92cfdd9764 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:38.410324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0c18-a7bc-40f7-bbb1-0c30f814a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:38.411158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0c18-a7bc-40f7-bbb1-0c30f814a925 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:38.411664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0c18-a7bc-40f7-bbb1-0c30f814a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:38.412141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0c18-a7bc-40f7-bbb1-0c30f814a925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:38.413004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0c18-a7bc-40f7-bbb1-0c30f814a925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:38.414768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0c18-a7bc-40f7-bbb1-0c30f814a925 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:38.439812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1042/2068] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:38.441062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ed913-bfec-4e99-b9e2-104002faa347 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:38.455004 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ed913-bfec-4e99-b9e2-104002faa347 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:38.477345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6aa0c-93a8-4ddd-a6df-6ca55d7b3ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:38.478410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6aa0c-93a8-4ddd-a6df-6ca55d7b3ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:38.478901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6aa0c-93a8-4ddd-a6df-6ca55d7b3ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:38.479256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6aa0c-93a8-4ddd-a6df-6ca55d7b3ab3 admin admin] PATH_INFO: `/v3/projects/09d32d2b02b647b99bf034b4df02159c/users/1230a9d91aa64b11acb3d8483dffd434/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:38.504109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6aa0c-93a8-4ddd-a6df-6ca55d7b3ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d32d2b02b647b99bf034b4df02159c, user_id=1230a9d91aa64b11acb3d8483dffd434, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:38.507364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6aa0c-93a8-4ddd-a6df-6ca55d7b3ab3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:38.511123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:38.529089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1027/2069] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:38 2022] PUT /identity/v3/projects/09d32d2b02b647b99bf034b4df02159c/users/1230a9d91aa64b11acb3d8483dffd434/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:38.539690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aabb1-80b7-484c-808d-1ffe82b4c3fa None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:38.540091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aabb1-80b7-484c-808d-1ffe82b4c3fa None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:38.540521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aabb1-80b7-484c-808d-1ffe82b4c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:38.598568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-341aabb1-80b7-484c-808d-1ffe82b4c3fa None None] MFA Rules not processed for user `1230a9d91aa64b11acb3d8483dffd434`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:38.600326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-341aabb1-80b7-484c-808d-1ffe82b4c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:38.719719 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1043/2070] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:38.725226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6aa0c-93a8-4ddd-a6df-6ca55d7b3ab3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:38.907466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6aa0c-93a8-4ddd-a6df-6ca55d7b3ab3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:38.916874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fe39a-0718-435c-9693-1b20735a45b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:38.917556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fe39a-0718-435c-9693-1b20735a45b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:38.917843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fe39a-0718-435c-9693-1b20735a45b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:38.920617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fe39a-0718-435c-9693-1b20735a45b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:38.923587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fe39a-0718-435c-9693-1b20735a45b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:38.926940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fe39a-0718-435c-9693-1b20735a45b5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:38.973754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1028/2071] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:38 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:38.977793 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aabb1-80b7-484c-808d-1ffe82b4c3fa None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:39.001684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aabb1-80b7-484c-808d-1ffe82b4c3fa None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:39.128745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:39.151604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aed97-8b54-4668-a47a-4f903421ed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:39.152841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aed97-8b54-4668-a47a-4f903421ed5a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:39.153126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aed97-8b54-4668-a47a-4f903421ed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:39.153400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aed97-8b54-4668-a47a-4f903421ed5a admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:39.156938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aed97-8b54-4668-a47a-4f903421ed5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:39.158977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aed97-8b54-4668-a47a-4f903421ed5a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:39.227324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1044/2072] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:38 2022] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:39.231221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fe39a-0718-435c-9693-1b20735a45b5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:39.253612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fe39a-0718-435c-9693-1b20735a45b5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:39.273053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dfd7b-4a8c-4841-9f98-3473e1f83595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:39.275809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dfd7b-4a8c-4841-9f98-3473e1f83595 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:39.276110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dfd7b-4a8c-4841-9f98-3473e1f83595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:39.276448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dfd7b-4a8c-4841-9f98-3473e1f83595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:39.277216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dfd7b-4a8c-4841-9f98-3473e1f83595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:39.281957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dfd7b-4a8c-4841-9f98-3473e1f83595 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:39.314960 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1029/2073] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:39.319990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aed97-8b54-4668-a47a-4f903421ed5a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:39.337864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aed97-8b54-4668-a47a-4f903421ed5a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:39.351974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eebdda-dbd1-4463-8251-4f87d7f8427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:39.352910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eebdda-dbd1-4463-8251-4f87d7f8427b admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:39.354618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eebdda-dbd1-4463-8251-4f87d7f8427b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:39.354912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eebdda-dbd1-4463-8251-4f87d7f8427b admin admin] PATH_INFO: `/v3/projects/9cdb31c060384e80a8aa415372102553/users/cd5c873460404a90b06a3e06c85049e7/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:39.395887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eebdda-dbd1-4463-8251-4f87d7f8427b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdb31c060384e80a8aa415372102553, user_id=cd5c873460404a90b06a3e06c85049e7, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:39.400330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eebdda-dbd1-4463-8251-4f87d7f8427b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:39.454275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1045/2074] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:39 2022] PUT /identity/v3/projects/9cdb31c060384e80a8aa415372102553/users/cd5c873460404a90b06a3e06c85049e7/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:39.458068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dfd7b-4a8c-4841-9f98-3473e1f83595 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:39.474923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dfd7b-4a8c-4841-9f98-3473e1f83595 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:39.614486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545c7b3-b299-4f3e-8c22-a7ad786b2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:39.615258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545c7b3-b299-4f3e-8c22-a7ad786b2776 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:39.615621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545c7b3-b299-4f3e-8c22-a7ad786b2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:39.615970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545c7b3-b299-4f3e-8c22-a7ad786b2776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:39.616798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545c7b3-b299-4f3e-8c22-a7ad786b2776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:39.618854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545c7b3-b299-4f3e-8c22-a7ad786b2776 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:39.632791 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1030/2075] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:39.636806 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eebdda-dbd1-4463-8251-4f87d7f8427b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:39.650789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eebdda-dbd1-4463-8251-4f87d7f8427b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:39.662265 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e21a8e-b5c1-4e9a-96ac-59c88219f46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:39.663593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e21a8e-b5c1-4e9a-96ac-59c88219f46c admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:39.664084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e21a8e-b5c1-4e9a-96ac-59c88219f46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:39.664557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e21a8e-b5c1-4e9a-96ac-59c88219f46c admin admin] PATH_INFO: `/v3/projects/9cdb31c060384e80a8aa415372102553/users/cd5c873460404a90b06a3e06c85049e7/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:39.667012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e21a8e-b5c1-4e9a-96ac-59c88219f46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdb31c060384e80a8aa415372102553, user_id=cd5c873460404a90b06a3e06c85049e7, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:39.670019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e21a8e-b5c1-4e9a-96ac-59c88219f46c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:39.690277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1046/2076] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:39 2022] PUT /identity/v3/projects/9cdb31c060384e80a8aa415372102553/users/cd5c873460404a90b06a3e06c85049e7/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:39.702012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8765f-dd2a-498d-9cdd-6852cd6cd044 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:39.702304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8765f-dd2a-498d-9cdd-6852cd6cd044 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:39.702614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8765f-dd2a-498d-9cdd-6852cd6cd044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:39.740626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-44b8765f-dd2a-498d-9cdd-6852cd6cd044 None None] MFA Rules not processed for user `cd5c873460404a90b06a3e06c85049e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:39.743189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-44b8765f-dd2a-498d-9cdd-6852cd6cd044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:39.899502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:39.939698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1031/2077] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:39.948663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e21a8e-b5c1-4e9a-96ac-59c88219f46c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:39.951154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-25e21a8e-b5c1-4e9a-96ac-59c88219f46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:40.058388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e21a8e-b5c1-4e9a-96ac-59c88219f46c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:40.064919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835bcb-a071-4445-a4d4-27cf50fc42e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:40.066002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835bcb-a071-4445-a4d4-27cf50fc42e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:40.066491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835bcb-a071-4445-a4d4-27cf50fc42e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:40.066917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6835bcb-a071-4445-a4d4-27cf50fc42e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:40.188776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6835bcb-a071-4445-a4d4-27cf50fc42e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:40.200811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6835bcb-a071-4445-a4d4-27cf50fc42e6 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:40.225203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1047/2078] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:41.874964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126b233-17c1-4666-954f-36ffa4c721cf None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:41.876057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126b233-17c1-4666-954f-36ffa4c721cf None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:41.876343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126b233-17c1-4666-954f-36ffa4c721cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:41.905165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5126b233-17c1-4666-954f-36ffa4c721cf None None] MFA Rules not processed for user `1259a413fdb7499ab01e89475c3d4369`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:41.906846 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5126b233-17c1-4666-954f-36ffa4c721cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:41.993760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1032/2079] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:42.026903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835bcb-a071-4445-a4d4-27cf50fc42e6 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:42.029274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b6835bcb-a071-4445-a4d4-27cf50fc42e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:42.078243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126b233-17c1-4666-954f-36ffa4c721cf None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:42.080025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5126b233-17c1-4666-954f-36ffa4c721cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:42.093968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126b233-17c1-4666-954f-36ffa4c721cf None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:42.099933 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622469d-cfd4-4692-9159-fb1cfa876f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:42.100694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622469d-cfd4-4692-9159-fb1cfa876f7c service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:42.101078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622469d-cfd4-4692-9159-fb1cfa876f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:42.101459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622469d-cfd4-4692-9159-fb1cfa876f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:42.101606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6835bcb-a071-4445-a4d4-27cf50fc42e6 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:42.105529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7078-c517-46be-ab2b-bfcf0f4a9e01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe27c3402a741f0a80d87ae6ecd3f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:42.106347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7078-c517-46be-ab2b-bfcf0f4a9e01 service glance] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:42.106677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7078-c517-46be-ab2b-bfcf0f4a9e01 service glance] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:42.107024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7078-c517-46be-ab2b-bfcf0f4a9e01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:42.122710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-923d7078-c517-46be-ab2b-bfcf0f4a9e01 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:42.131307 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:42.181810 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622469d-cfd4-4692-9159-fb1cfa876f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:42.183581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622469d-cfd4-4692-9159-fb1cfa876f7c service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:42.196503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1033/2080] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:42.212274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d7078-c517-46be-ab2b-bfcf0f4a9e01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:42.214311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d7078-c517-46be-ab2b-bfcf0f4a9e01 service glance] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:42.225400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1048/2081] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:42.448710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9372d0-ea00-4cc7-95f1-32c728080c90 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:42.449568 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9372d0-ea00-4cc7-95f1-32c728080c90 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:42.450031 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9372d0-ea00-4cc7-95f1-32c728080c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:42.486013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ca9372d0-ea00-4cc7-95f1-32c728080c90 None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:42.487571 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ca9372d0-ea00-4cc7-95f1-32c728080c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:42.585078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1034/2082] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:33:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:42.664207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7078-c517-46be-ab2b-bfcf0f4a9e01 service glance] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:42.665285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-923d7078-c517-46be-ab2b-bfcf0f4a9e01 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:42.771112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7078-c517-46be-ab2b-bfcf0f4a9e01 service glance] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:42.776340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6099c0-1059-4391-9c93-51ef0aaf2b73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:42.777058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6099c0-1059-4391-9c93-51ef0aaf2b73 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:42.777410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6099c0-1059-4391-9c93-51ef0aaf2b73 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:42.777756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6099c0-1059-4391-9c93-51ef0aaf2b73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:42.786212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6099c0-1059-4391-9c93-51ef0aaf2b73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:42.787845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6099c0-1059-4391-9c93-51ef0aaf2b73 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:42.796103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1049/2083] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:33:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:33:43.185187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9372d0-ea00-4cc7-95f1-32c728080c90 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:43.198306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9372d0-ea00-4cc7-95f1-32c728080c90 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:43.206834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b09d8f-48ff-4d80-ae45-55e197ed1b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:43.208554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09d8f-48ff-4d80-ae45-55e197ed1b1c service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:43.210726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09d8f-48ff-4d80-ae45-55e197ed1b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:43.211192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09d8f-48ff-4d80-ae45-55e197ed1b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:43.228649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b09d8f-48ff-4d80-ae45-55e197ed1b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:43.230388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b09d8f-48ff-4d80-ae45-55e197ed1b1c service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:43.243587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1035/2084] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:47.859008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6099c0-1059-4391-9c93-51ef0aaf2b73 service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:48.011841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6099c0-1059-4391-9c93-51ef0aaf2b73 service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:48.020757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:48.021752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:48.022043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:48.022325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] PATH_INFO: `/v3/users/038a091689b9402194712a76c450ce06` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:48.023684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038a091689b9402194712a76c450ce06)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:48.025733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:48.140298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:48.160570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038a091689b9402194712a76c450ce06'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:48.161789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038a091689b9402194712a76c450ce06'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:48.183715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038a091689b9402194712a76c450ce06'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:48.208005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038a091689b9402194712a76c450ce06'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:48.228944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038a091689b9402194712a76c450ce06'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:48.249909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1050/2085] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:47 2022] DELETE /identity/v3/users/038a091689b9402194712a76c450ce06 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:48.253408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111daad-0b61-4997-97fb-38a8654e1ecc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:48.254296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111daad-0b61-4997-97fb-38a8654e1ecc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:48.254842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111daad-0b61-4997-97fb-38a8654e1ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:48.327395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:48.335144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5111daad-0b61-4997-97fb-38a8654e1ecc None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:48.337413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5111daad-0b61-4997-97fb-38a8654e1ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:48.506059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1036/2086] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:48.516959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:48.519242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:48.632456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8253e-db98-4b38-84cc-7330937908a7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:48.649391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57f22a-941b-4eab-868b-16ee32eeddc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:48.650950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57f22a-941b-4eab-868b-16ee32eeddc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:48.651242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57f22a-941b-4eab-868b-16ee32eeddc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:48.651565 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57f22a-941b-4eab-868b-16ee32eeddc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:48.663614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111daad-0b61-4997-97fb-38a8654e1ecc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:48.665036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5111daad-0b61-4997-97fb-38a8654e1ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:48.690054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57f22a-941b-4eab-868b-16ee32eeddc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:48.691302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57f22a-941b-4eab-868b-16ee32eeddc0 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:48.697903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111daad-0b61-4997-97fb-38a8654e1ecc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:48.706844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1051/2087] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:48.715385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:48.716579 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:48.717698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:48.718132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] PATH_INFO: `/v3/users/4fc4ced89bd741f7ac92e5a5a2dc6653` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:48.720193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc4ced89bd741f7ac92e5a5a2dc6653)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:48.723357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:48.851309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc4ced89bd741f7ac92e5a5a2dc6653'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:48.853592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc4ced89bd741f7ac92e5a5a2dc6653'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:48.854597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc4ced89bd741f7ac92e5a5a2dc6653'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:48.899769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc4ced89bd741f7ac92e5a5a2dc6653'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:48.951052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc4ced89bd741f7ac92e5a5a2dc6653'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:48.978977 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1037/2088] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:48 2022] DELETE /identity/v3/users/4fc4ced89bd741f7ac92e5a5a2dc6653 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:49.340845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57f22a-941b-4eab-868b-16ee32eeddc0 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:49.384888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57f22a-941b-4eab-868b-16ee32eeddc0 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:49.437317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:49.438817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:49.510866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:49.511953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:49.512335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:49.512707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] PATH_INFO: `/v3/projects/35d691c5a5b340438cff9eb0b46ed89f` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:49.514243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d691c5a5b340438cff9eb0b46ed89f)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:49.516440 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:49.600472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8abd5-f081-4f14-84f6-1dc3097766cf admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:49.605287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d691c5a5b340438cff9eb0b46ed89f', 'request_id': 'req-522b12b5-75f9-457f-a91a-29bee2b98f71'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:49.619780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d691c5a5b340438cff9eb0b46ed89f', 'request_id': 'req-522b12b5-75f9-457f-a91a-29bee2b98f71'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:49.625431 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:49.647396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d691c5a5b340438cff9eb0b46ed89f', 'request_id': 'req-522b12b5-75f9-457f-a91a-29bee2b98f71'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:49.657231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:49.680956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] The token cache is being invalidate because project 35d691c5a5b340438cff9eb0b46ed89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:49.681260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:49.682711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-522b12b5-75f9-457f-a91a-29bee2b98f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:49.688125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1052/2089] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:49 2022] DELETE /identity/v3/projects/35d691c5a5b340438cff9eb0b46ed89f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:49.697106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5f6f2-73ca-45fe-b6f6-35eb09ccac3f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:49.697412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5f6f2-73ca-45fe-b6f6-35eb09ccac3f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:49.697784 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5f6f2-73ca-45fe-b6f6-35eb09ccac3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:49.720479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0bc5f6f2-73ca-45fe-b6f6-35eb09ccac3f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:49.726947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0bc5f6f2-73ca-45fe-b6f6-35eb09ccac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:49.732595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:49.733619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:49.734147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:49.734708 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] PATH_INFO: `/v3/projects/69e88777ab664665af8d076206655acd` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:49.736250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e88777ab664665af8d076206655acd)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:49.739385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:49.744439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1053/2090] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:49.752202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ae8d2-54b5-47dd-9184-7bed295021a3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:49.752494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ae8d2-54b5-47dd-9184-7bed295021a3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:49.752775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ae8d2-54b5-47dd-9184-7bed295021a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:49.777643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a82ae8d2-54b5-47dd-9184-7bed295021a3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:49.779094 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a82ae8d2-54b5-47dd-9184-7bed295021a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:49.794497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1054/2091] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:49.798531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ae8d2-54b5-47dd-9184-7bed295021a3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:49.821017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ae8d2-54b5-47dd-9184-7bed295021a3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:49.834465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e88777ab664665af8d076206655acd', 'request_id': 'req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:49.841043 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e88777ab664665af8d076206655acd', 'request_id': 'req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:49.849419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e88777ab664665af8d076206655acd', 'request_id': 'req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:49.886720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] The token cache is being invalidate because project 69e88777ab664665af8d076206655acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:49.887434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:49.888495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:49.894120 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1038/2092] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:49 2022] DELETE /identity/v3/projects/69e88777ab664665af8d076206655acd => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:49.895350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:49.897607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:49.922982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52a6cd-ba57-4b73-ac83-b4994efa8704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:49.925234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52a6cd-ba57-4b73-ac83-b4994efa8704 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:49.925701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52a6cd-ba57-4b73-ac83-b4994efa8704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:49.926150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52a6cd-ba57-4b73-ac83-b4994efa8704 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:49.927093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52a6cd-ba57-4b73-ac83-b4994efa8704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:49.927575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52a6cd-ba57-4b73-ac83-b4994efa8704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:49.929418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52a6cd-ba57-4b73-ac83-b4994efa8704 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:49.944204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1055/2093] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:33:49.950656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52a6cd-ba57-4b73-ac83-b4994efa8704 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:49.958062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-be52a6cd-ba57-4b73-ac83-b4994efa8704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:49.977935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52a6cd-ba57-4b73-ac83-b4994efa8704 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:50.010346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e681fc4-ff81-464c-85bd-2e4a9bc6859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:50.011428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e681fc4-ff81-464c-85bd-2e4a9bc6859f admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:50.011700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e681fc4-ff81-464c-85bd-2e4a9bc6859f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:50.012039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e681fc4-ff81-464c-85bd-2e4a9bc6859f admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:50.012809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e681fc4-ff81-464c-85bd-2e4a9bc6859f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:50.020132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e681fc4-ff81-464c-85bd-2e4a9bc6859f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:50.047185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad8db-0334-4ce9-b7fe-a2ceaba19bfb admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:50.055558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:50.056959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:50.057342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:50.058220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] PATH_INFO: `/v3/users/1230a9d91aa64b11acb3d8483dffd434` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:50.059569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1230a9d91aa64b11acb3d8483dffd434)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:50.061752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:50.093555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1056/2094] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:49 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:50.097772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e681fc4-ff81-464c-85bd-2e4a9bc6859f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:50.155889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1230a9d91aa64b11acb3d8483dffd434'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:50.158845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1230a9d91aa64b11acb3d8483dffd434'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:50.160781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1230a9d91aa64b11acb3d8483dffd434'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:50.183270 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:50.217148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1230a9d91aa64b11acb3d8483dffd434'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:50.235740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e681fc4-ff81-464c-85bd-2e4a9bc6859f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:50.240191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1230a9d91aa64b11acb3d8483dffd434'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:50.249625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54110d-bac4-4edb-b9ae-f1dbb8f5f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:50.250534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54110d-bac4-4edb-b9ae-f1dbb8f5f068 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:50.251935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54110d-bac4-4edb-b9ae-f1dbb8f5f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:50.252292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54110d-bac4-4edb-b9ae-f1dbb8f5f068 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:50.254897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54110d-bac4-4edb-b9ae-f1dbb8f5f068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:50.257029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54110d-bac4-4edb-b9ae-f1dbb8f5f068 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:50.265191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1039/2095] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:49 2022] DELETE /identity/v3/users/1230a9d91aa64b11acb3d8483dffd434 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:50.290532 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1057/2096] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:50 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:50.291895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:50.293321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:50.423781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9abf0-5ba3-42ec-837c-0d91c0e684ec admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:50.429869 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4e6ee-6f74-4739-b0da-3ca439e9651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:50.432145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e6ee-6f74-4739-b0da-3ca439e9651e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:50.433069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e6ee-6f74-4739-b0da-3ca439e9651e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:50.433847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e6ee-6f74-4739-b0da-3ca439e9651e admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:50.434726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4e6ee-6f74-4739-b0da-3ca439e9651e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:50.438097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4e6ee-6f74-4739-b0da-3ca439e9651e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:50.459531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1040/2097] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:50.465488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54110d-bac4-4edb-b9ae-f1dbb8f5f068 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:50.478942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54110d-bac4-4edb-b9ae-f1dbb8f5f068 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:50.484600 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51849f0-d8d2-4dcf-8e39-77a4488700db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:50.485429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51849f0-d8d2-4dcf-8e39-77a4488700db admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:50.485980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51849f0-d8d2-4dcf-8e39-77a4488700db admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:50.486197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51849f0-d8d2-4dcf-8e39-77a4488700db admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:50.489360 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51849f0-d8d2-4dcf-8e39-77a4488700db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:50.489360 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51849f0-d8d2-4dcf-8e39-77a4488700db admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:50.505606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1058/2098] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:50.509517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4e6ee-6f74-4739-b0da-3ca439e9651e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:50.524872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4e6ee-6f74-4739-b0da-3ca439e9651e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:50.530063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a46b6-dd26-4f30-8662-3ee809be726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:50.531897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a46b6-dd26-4f30-8662-3ee809be726e admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:50.532193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a46b6-dd26-4f30-8662-3ee809be726e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:50.532586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a46b6-dd26-4f30-8662-3ee809be726e admin admin] PATH_INFO: `/v3/projects/e2c16f0ae9194344b2175b57b763d717/users/57b7e463c01740f796b13357262a792e/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:50.558833 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a46b6-dd26-4f30-8662-3ee809be726e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c16f0ae9194344b2175b57b763d717, user_id=57b7e463c01740f796b13357262a792e, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:50.561733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a46b6-dd26-4f30-8662-3ee809be726e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:50.606821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1041/2099] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:50 2022] PUT /identity/v3/projects/e2c16f0ae9194344b2175b57b763d717/users/57b7e463c01740f796b13357262a792e/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:50.608567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35383f72-76ad-47cb-8780-3955a07d10fb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:50.609051 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35383f72-76ad-47cb-8780-3955a07d10fb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:50.609623 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35383f72-76ad-47cb-8780-3955a07d10fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:50.644894 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-35383f72-76ad-47cb-8780-3955a07d10fb None None] MFA Rules not processed for user `57b7e463c01740f796b13357262a792e`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:50.646641 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-35383f72-76ad-47cb-8780-3955a07d10fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:50.672735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:50.729327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a46b6-dd26-4f30-8662-3ee809be726e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:50.732602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3a2a46b6-dd26-4f30-8662-3ee809be726e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:50.794507 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1059/2100] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:50.798630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35383f72-76ad-47cb-8780-3955a07d10fb None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:50.846242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a46b6-dd26-4f30-8662-3ee809be726e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:50.855407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:50.856456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:50.856812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:50.857164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] PATH_INFO: `/v3/projects/09d32d2b02b647b99bf034b4df02159c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:50.858482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d32d2b02b647b99bf034b4df02159c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:50.860907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:50.895394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35383f72-76ad-47cb-8780-3955a07d10fb None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:50.905967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0730e-a993-43de-b8b2-d087482d9c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:50.907484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0730e-a993-43de-b8b2-d087482d9c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:50.907967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0730e-a993-43de-b8b2-d087482d9c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:50.908585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0730e-a993-43de-b8b2-d087482d9c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:50.909516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0730e-a993-43de-b8b2-d087482d9c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:50.911924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0730e-a993-43de-b8b2-d087482d9c6d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:50.955901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d32d2b02b647b99bf034b4df02159c', 'request_id': 'req-1916e5fa-7223-4639-8798-d84366548993'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:50.964198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:50.975582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d32d2b02b647b99bf034b4df02159c', 'request_id': 'req-1916e5fa-7223-4639-8798-d84366548993'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:51.013903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d32d2b02b647b99bf034b4df02159c', 'request_id': 'req-1916e5fa-7223-4639-8798-d84366548993'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:51.035182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1060/2101] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:50 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:33:51.039853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0730e-a993-43de-b8b2-d087482d9c6d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:51.093778 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] The token cache is being invalidate because project 09d32d2b02b647b99bf034b4df02159c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:51.094608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:51.096480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:51.099464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1042/2102] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:50 2022] DELETE /identity/v3/projects/09d32d2b02b647b99bf034b4df02159c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:51.104809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:51.109412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:51.212423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e5fa-7223-4639-8798-d84366548993 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:51.212670 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0730e-a993-43de-b8b2-d087482d9c6d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:51.217595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:51.217922 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003a9c3-a585-44c6-864e-98fe47cbc3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:51.218519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:51.218660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003a9c3-a585-44c6-864e-98fe47cbc3fc admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:51.218868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:51.218991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003a9c3-a585-44c6-864e-98fe47cbc3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:51.219076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] PATH_INFO: `/v3/users/cd5c873460404a90b06a3e06c85049e7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:51.219155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003a9c3-a585-44c6-864e-98fe47cbc3fc admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:51.219967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003a9c3-a585-44c6-864e-98fe47cbc3fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:51.220405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd5c873460404a90b06a3e06c85049e7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:51.222646 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003a9c3-a585-44c6-864e-98fe47cbc3fc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:51.222899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:51.251593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1061/2103] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:51 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:51.255345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003a9c3-a585-44c6-864e-98fe47cbc3fc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:51.262991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b003a9c3-a585-44c6-864e-98fe47cbc3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:51.287048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003a9c3-a585-44c6-864e-98fe47cbc3fc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:51.299281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3521105-ce68-44a5-b3e9-592d7b6fd334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:51.301235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3521105-ce68-44a5-b3e9-592d7b6fd334 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:51.301524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3521105-ce68-44a5-b3e9-592d7b6fd334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:51.301803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3521105-ce68-44a5-b3e9-592d7b6fd334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:51.303064 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3521105-ce68-44a5-b3e9-592d7b6fd334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:51.305181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3521105-ce68-44a5-b3e9-592d7b6fd334 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:51.312284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd5c873460404a90b06a3e06c85049e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:51.313968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd5c873460404a90b06a3e06c85049e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:51.316797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd5c873460404a90b06a3e06c85049e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:51.327405 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1062/2104] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:51.328411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3521105-ce68-44a5-b3e9-592d7b6fd334 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:51.330457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e3521105-ce68-44a5-b3e9-592d7b6fd334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:51.348114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd5c873460404a90b06a3e06c85049e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:51.351070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3521105-ce68-44a5-b3e9-592d7b6fd334 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:51.359077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797c098-e70d-4ad9-a42c-0d02950c8801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:51.360652 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797c098-e70d-4ad9-a42c-0d02950c8801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:51.360940 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797c098-e70d-4ad9-a42c-0d02950c8801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:51.361327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797c098-e70d-4ad9-a42c-0d02950c8801 admin admin] PATH_INFO: `/v3/projects/2ca76fbc891d47859ced9c08160f92fb/users/3ec7c89e0cb2448586da644f19614850/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:51.367427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd5c873460404a90b06a3e06c85049e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:51.398444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797c098-e70d-4ad9-a42c-0d02950c8801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca76fbc891d47859ced9c08160f92fb, user_id=3ec7c89e0cb2448586da644f19614850, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:51.405721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797c098-e70d-4ad9-a42c-0d02950c8801 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:51.415914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:51.418011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1043/2105] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:51 2022] DELETE /identity/v3/users/cd5c873460404a90b06a3e06c85049e7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:51.435360 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1063/2106] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:51 2022] PUT /identity/v3/projects/2ca76fbc891d47859ced9c08160f92fb/users/3ec7c89e0cb2448586da644f19614850/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:51.439570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:51.521890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:51.530406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5cdeb-5a38-4983-bcbf-af7344926818 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:51.629762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a60c6-d8c4-43ec-bbcd-5d0935e7b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:51.630482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a60c6-d8c4-43ec-bbcd-5d0935e7b0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:51.630767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a60c6-d8c4-43ec-bbcd-5d0935e7b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:51.631047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a60c6-d8c4-43ec-bbcd-5d0935e7b0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:51.631811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a60c6-d8c4-43ec-bbcd-5d0935e7b0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:51.633407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a60c6-d8c4-43ec-bbcd-5d0935e7b0d1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:51.645072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1044/2107] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:51.652206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797c098-e70d-4ad9-a42c-0d02950c8801 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:51.673312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797c098-e70d-4ad9-a42c-0d02950c8801 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:51.682160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbe83d-cb90-465e-aa77-b0c67d862bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:51.683564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbe83d-cb90-465e-aa77-b0c67d862bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:51.684074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbe83d-cb90-465e-aa77-b0c67d862bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:51.684560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbe83d-cb90-465e-aa77-b0c67d862bb3 admin admin] PATH_INFO: `/v3/projects/2ca76fbc891d47859ced9c08160f92fb/users/3ec7c89e0cb2448586da644f19614850/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:51.686660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbe83d-cb90-465e-aa77-b0c67d862bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca76fbc891d47859ced9c08160f92fb, user_id=3ec7c89e0cb2448586da644f19614850, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:51.702215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbe83d-cb90-465e-aa77-b0c67d862bb3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:51.714958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1064/2108] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:51 2022] PUT /identity/v3/projects/2ca76fbc891d47859ced9c08160f92fb/users/3ec7c89e0cb2448586da644f19614850/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:51.729140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bda4f2-9b76-489e-8f5d-1f90799ab382 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:51.729433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bda4f2-9b76-489e-8f5d-1f90799ab382 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:51.729710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bda4f2-9b76-489e-8f5d-1f90799ab382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:51.766019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-01bda4f2-9b76-489e-8f5d-1f90799ab382 None None] MFA Rules not processed for user `3ec7c89e0cb2448586da644f19614850`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:51.767290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-01bda4f2-9b76-489e-8f5d-1f90799ab382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:51.830051 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbe83d-cb90-465e-aa77-b0c67d862bb3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:51.832856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6fdbe83d-cb90-465e-aa77-b0c67d862bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:51.928205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1045/2109] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:51.941729 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bda4f2-9b76-489e-8f5d-1f90799ab382 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:51.943194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-01bda4f2-9b76-489e-8f5d-1f90799ab382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:51.943715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbe83d-cb90-465e-aa77-b0c67d862bb3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:51.948594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:51.949534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:51.949832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:51.950105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] PATH_INFO: `/v3/projects/9cdb31c060384e80a8aa415372102553` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:51.951423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cdb31c060384e80a8aa415372102553)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:51.953663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:52.022549 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bda4f2-9b76-489e-8f5d-1f90799ab382 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:52.030536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cdb31c060384e80a8aa415372102553', 'request_id': 'req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:52.042886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cdb31c060384e80a8aa415372102553', 'request_id': 'req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:52.056210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cdb31c060384e80a8aa415372102553', 'request_id': 'req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:52.084927 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] The token cache is being invalidate because project 9cdb31c060384e80a8aa415372102553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:52.085125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:52.085797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:52.093973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:52.098627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1065/2110] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:51 2022] DELETE /identity/v3/projects/9cdb31c060384e80a8aa415372102553 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:33:52.118250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf779bb-dc87-46c9-90c6-7fbd414fd0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:52.119592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf779bb-dc87-46c9-90c6-7fbd414fd0fa service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:52.120421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf779bb-dc87-46c9-90c6-7fbd414fd0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:52.120719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf779bb-dc87-46c9-90c6-7fbd414fd0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:52.125836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bcf779bb-dc87-46c9-90c6-7fbd414fd0fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:52.295973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf779bb-dc87-46c9-90c6-7fbd414fd0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:52.295973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf779bb-dc87-46c9-90c6-7fbd414fd0fa service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:52.300069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1046/2111] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:33:55.060593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:55.062140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:55.197568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e78bd-b2fa-411d-bddc-c8f46b40d7f7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:55.215530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:55.216477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:55.216759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:55.217036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] PATH_INFO: `/v3/users/57b7e463c01740f796b13357262a792e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:55.220147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b7e463c01740f796b13357262a792e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:55.224197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:55.247091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:55.298470 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b7e463c01740f796b13357262a792e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:55.299085 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b7e463c01740f796b13357262a792e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:55.314132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b7e463c01740f796b13357262a792e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:55.332062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b7e463c01740f796b13357262a792e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:55.342046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b7e463c01740f796b13357262a792e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:55.349521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1066/2112] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:55 2022] DELETE /identity/v3/users/57b7e463c01740f796b13357262a792e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:55.353804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954913b-ac09-4c23-a94b-5968a28bce09 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:55.354346 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954913b-ac09-4c23-a94b-5968a28bce09 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:55.354346 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954913b-ac09-4c23-a94b-5968a28bce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:55.373795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5954913b-ac09-4c23-a94b-5968a28bce09 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:55.375063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5954913b-ac09-4c23-a94b-5968a28bce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:55.447867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1047/2113] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:55.459310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:55.460921 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:55.534301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7213d-34a1-4fa7-971b-bcba46a87044 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:55.538669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b700232-63b6-48c9-a2eb-42fed8b6a5b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:55.539329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b700232-63b6-48c9-a2eb-42fed8b6a5b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:55.539609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b700232-63b6-48c9-a2eb-42fed8b6a5b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:55.539884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b700232-63b6-48c9-a2eb-42fed8b6a5b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:55.552428 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b700232-63b6-48c9-a2eb-42fed8b6a5b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:55.553787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b700232-63b6-48c9-a2eb-42fed8b6a5b0 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:55.564192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1067/2114] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:33:55.851895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954913b-ac09-4c23-a94b-5968a28bce09 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:55.854020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5954913b-ac09-4c23-a94b-5968a28bce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:55.865760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50702734-bf8a-498d-8fda-c70de433ca2d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:55.865953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50702734-bf8a-498d-8fda-c70de433ca2d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:55.866238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50702734-bf8a-498d-8fda-c70de433ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:55.869774 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954913b-ac09-4c23-a94b-5968a28bce09 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:55.874898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:55.875959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:55.876242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:55.876518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] PATH_INFO: `/v3/projects/e2c16f0ae9194344b2175b57b763d717` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:55.877743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c16f0ae9194344b2175b57b763d717)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:55.882412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:55.884825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-50702734-bf8a-498d-8fda-c70de433ca2d None None] MFA Rules not processed for user `445c6c39470d4fc3b7c72447effd9c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:55.886316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-50702734-bf8a-498d-8fda-c70de433ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:55.935034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c16f0ae9194344b2175b57b763d717', 'request_id': 'req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:55.941427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c16f0ae9194344b2175b57b763d717', 'request_id': 'req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:55.948490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1068/2115] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:55.948698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c16f0ae9194344b2175b57b763d717', 'request_id': 'req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:55.964075 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] The token cache is being invalidate because project e2c16f0ae9194344b2175b57b763d717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:55.964372 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:55.965001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:55.966627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1048/2116] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:55 2022] DELETE /identity/v3/projects/e2c16f0ae9194344b2175b57b763d717 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:55.970989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50702734-bf8a-498d-8fda-c70de433ca2d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:55.982599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50702734-bf8a-498d-8fda-c70de433ca2d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:56.025935 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:56.046220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:56.047135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:56.047419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:56.047697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] PATH_INFO: `/v3/users/3ec7c89e0cb2448586da644f19614850` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:56.048907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec7c89e0cb2448586da644f19614850)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:56.051614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:56.100404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec7c89e0cb2448586da644f19614850'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:56.101162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec7c89e0cb2448586da644f19614850'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:56.109103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec7c89e0cb2448586da644f19614850'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:56.127763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec7c89e0cb2448586da644f19614850'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:56.138156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0047f256-d526-479f-bbce-211eabe603cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec7c89e0cb2448586da644f19614850'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:56.144744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1069/2117] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:33:55 2022] DELETE /identity/v3/users/3ec7c89e0cb2448586da644f19614850 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:56.635602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:56.637308 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:56.653272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d6858-6f86-4d6b-b67c-5f80aaa90f3a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:56.674184 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:56.728578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:56.729528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:56.730051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:56.730335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] PATH_INFO: `/v3/projects/2ca76fbc891d47859ced9c08160f92fb` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:56.731756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca76fbc891d47859ced9c08160f92fb)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:56.733726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:56.796589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca76fbc891d47859ced9c08160f92fb', 'request_id': 'req-8cd200ec-f106-4122-bb57-0a4bb2599906'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:56.804768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca76fbc891d47859ced9c08160f92fb', 'request_id': 'req-8cd200ec-f106-4122-bb57-0a4bb2599906'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:56.811299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca76fbc891d47859ced9c08160f92fb', 'request_id': 'req-8cd200ec-f106-4122-bb57-0a4bb2599906'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:56.835338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] The token cache is being invalidate because project 2ca76fbc891d47859ced9c08160f92fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:33:56.835635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:56.836296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8cd200ec-f106-4122-bb57-0a4bb2599906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:33:56.837843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1049/2118] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:33:56 2022] DELETE /identity/v3/projects/2ca76fbc891d47859ced9c08160f92fb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:56.842740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f140d-e9a3-4a3f-be4e-c83332fae1be None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:56.843029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f140d-e9a3-4a3f-be4e-c83332fae1be None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:56.843331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f140d-e9a3-4a3f-be4e-c83332fae1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:56.861261 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-bf1f140d-e9a3-4a3f-be4e-c83332fae1be None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:56.864680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bf1f140d-e9a3-4a3f-be4e-c83332fae1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:56.934528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1070/2119] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:56.942626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e400b3-7161-46bb-ab81-820176ab586b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:56.942920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e400b3-7161-46bb-ab81-820176ab586b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:56.943210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e400b3-7161-46bb-ab81-820176ab586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:56.973632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-44e400b3-7161-46bb-ab81-820176ab586b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:56.974902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-44e400b3-7161-46bb-ab81-820176ab586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:56.983671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1050/2120] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:56.989020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f140d-e9a3-4a3f-be4e-c83332fae1be None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.000671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f140d-e9a3-4a3f-be4e-c83332fae1be None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.005568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87c15-bc05-4026-aaa3-4d32db9a92a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.006425 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87c15-bc05-4026-aaa3-4d32db9a92a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.006795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87c15-bc05-4026-aaa3-4d32db9a92a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.007080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87c15-bc05-4026-aaa3-4d32db9a92a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.007822 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e87c15-bc05-4026-aaa3-4d32db9a92a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:33:57.008133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e87c15-bc05-4026-aaa3-4d32db9a92a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.009741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e87c15-bc05-4026-aaa3-4d32db9a92a3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.026064 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1071/2121] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:33:57.027578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e400b3-7161-46bb-ab81-820176ab586b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.037720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e400b3-7161-46bb-ab81-820176ab586b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.042436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026bce9-fb48-4fa1-a450-60b0f31c4f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.043095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026bce9-fb48-4fa1-a450-60b0f31c4f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.043384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026bce9-fb48-4fa1-a450-60b0f31c4f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.043659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026bce9-fb48-4fa1-a450-60b0f31c4f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.044357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026bce9-fb48-4fa1-a450-60b0f31c4f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.046261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026bce9-fb48-4fa1-a450-60b0f31c4f0c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.073527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1051/2122] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:57 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:57.077729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87c15-bc05-4026-aaa3-4d32db9a92a3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.088012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87c15-bc05-4026-aaa3-4d32db9a92a3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.136035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:57.151780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239307a6-578e-4f1c-88fe-133691173499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.152663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239307a6-578e-4f1c-88fe-133691173499 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.152955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239307a6-578e-4f1c-88fe-133691173499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.153234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239307a6-578e-4f1c-88fe-133691173499 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.153941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239307a6-578e-4f1c-88fe-133691173499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.155966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239307a6-578e-4f1c-88fe-133691173499 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.182306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1072/2123] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:57 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:33:57.183610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026bce9-fb48-4fa1-a450-60b0f31c4f0c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.196998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026bce9-fb48-4fa1-a450-60b0f31c4f0c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.202287 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e384c-9dbb-40a0-8c52-da16078ab6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.203101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e384c-9dbb-40a0-8c52-da16078ab6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.203536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e384c-9dbb-40a0-8c52-da16078ab6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.203785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e384c-9dbb-40a0-8c52-da16078ab6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.204588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e384c-9dbb-40a0-8c52-da16078ab6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.206253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e384c-9dbb-40a0-8c52-da16078ab6ee admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.218733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1052/2124] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:57.223448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239307a6-578e-4f1c-88fe-133691173499 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.235144 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239307a6-578e-4f1c-88fe-133691173499 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.241300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59870489-7990-49fb-8b25-69ef880cecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.242106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59870489-7990-49fb-8b25-69ef880cecab admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.242457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59870489-7990-49fb-8b25-69ef880cecab admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.242752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59870489-7990-49fb-8b25-69ef880cecab admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.243586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59870489-7990-49fb-8b25-69ef880cecab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.245316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59870489-7990-49fb-8b25-69ef880cecab admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.256810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1073/2125] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:57.261020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e384c-9dbb-40a0-8c52-da16078ab6ee admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.273088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e384c-9dbb-40a0-8c52-da16078ab6ee admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.277777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29cc67-20a1-4157-a287-560eae27e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.278702 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cc67-20a1-4157-a287-560eae27e874 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.278987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cc67-20a1-4157-a287-560eae27e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.279261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cc67-20a1-4157-a287-560eae27e874 admin admin] PATH_INFO: `/v3/projects/152ebabdbffb49a2b68c5c693f1ec44b/users/c56b9e9fb41f41ea93e030b100b19e6e/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.295577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29cc67-20a1-4157-a287-560eae27e874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=152ebabdbffb49a2b68c5c693f1ec44b, user_id=c56b9e9fb41f41ea93e030b100b19e6e, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.298298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29cc67-20a1-4157-a287-560eae27e874 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.314485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1053/2126] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:57 2022] PUT /identity/v3/projects/152ebabdbffb49a2b68c5c693f1ec44b/users/c56b9e9fb41f41ea93e030b100b19e6e/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:57.326686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa98d6-b170-4ed1-9566-8a64dbe06347 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.327218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa98d6-b170-4ed1-9566-8a64dbe06347 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.327493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa98d6-b170-4ed1-9566-8a64dbe06347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.355243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a7aa98d6-b170-4ed1-9566-8a64dbe06347 None None] MFA Rules not processed for user `c56b9e9fb41f41ea93e030b100b19e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:57.356483 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a7aa98d6-b170-4ed1-9566-8a64dbe06347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:57.427460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1074/2127] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:57.431773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29cc67-20a1-4157-a287-560eae27e874 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.479787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:57.495842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29cc67-20a1-4157-a287-560eae27e874 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.500568 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b5c68-5f39-42b9-8db6-9d23a7f28a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.501230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b5c68-5f39-42b9-8db6-9d23a7f28a41 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.501520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b5c68-5f39-42b9-8db6-9d23a7f28a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.501805 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b5c68-5f39-42b9-8db6-9d23a7f28a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.502545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b5c68-5f39-42b9-8db6-9d23a7f28a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.504483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b5c68-5f39-42b9-8db6-9d23a7f28a41 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.531664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1054/2128] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:57 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:57.536465 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa98d6-b170-4ed1-9566-8a64dbe06347 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.548320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa98d6-b170-4ed1-9566-8a64dbe06347 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.607860 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3d254-76fc-4d03-af0e-1420c25f7f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.608533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3d254-76fc-4d03-af0e-1420c25f7f39 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.608815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3d254-76fc-4d03-af0e-1420c25f7f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.609085 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3d254-76fc-4d03-af0e-1420c25f7f39 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.609783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3d254-76fc-4d03-af0e-1420c25f7f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.611727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3d254-76fc-4d03-af0e-1420c25f7f39 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.637006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1075/2129] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:57 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:57.638138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b5c68-5f39-42b9-8db6-9d23a7f28a41 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.649900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b5c68-5f39-42b9-8db6-9d23a7f28a41 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.656859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26941981-f9a3-4c40-a281-f7e9a2a88fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.657657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26941981-f9a3-4c40-a281-f7e9a2a88fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.658251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26941981-f9a3-4c40-a281-f7e9a2a88fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.658381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26941981-f9a3-4c40-a281-f7e9a2a88fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.659182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26941981-f9a3-4c40-a281-f7e9a2a88fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.661405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26941981-f9a3-4c40-a281-f7e9a2a88fd5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.675774 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1055/2130] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:57.679849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3d254-76fc-4d03-af0e-1420c25f7f39 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.690961 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3d254-76fc-4d03-af0e-1420c25f7f39 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.695878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022ca80-4cb5-4ce8-9238-48193a298c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.696804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022ca80-4cb5-4ce8-9238-48193a298c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.697292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022ca80-4cb5-4ce8-9238-48193a298c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.697567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022ca80-4cb5-4ce8-9238-48193a298c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.698437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022ca80-4cb5-4ce8-9238-48193a298c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.700248 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022ca80-4cb5-4ce8-9238-48193a298c49 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.715477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1076/2131] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:57.723666 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26941981-f9a3-4c40-a281-f7e9a2a88fd5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:57.735229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26941981-f9a3-4c40-a281-f7e9a2a88fd5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:57.743511 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acabc10-3cac-4419-b33e-c8bd82a9c0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:57.744794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acabc10-3cac-4419-b33e-c8bd82a9c0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.745083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acabc10-3cac-4419-b33e-c8bd82a9c0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.745414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acabc10-3cac-4419-b33e-c8bd82a9c0f7 admin admin] PATH_INFO: `/v3/projects/4612ac3b6eba4d9c8970ebfecab9c6b1/users/26a305bf12c94c779e022beee7585a56/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.767274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acabc10-3cac-4419-b33e-c8bd82a9c0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4612ac3b6eba4d9c8970ebfecab9c6b1, user_id=26a305bf12c94c779e022beee7585a56, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:57.772239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acabc10-3cac-4419-b33e-c8bd82a9c0f7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:57.815056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1056/2132] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:57 2022] PUT /identity/v3/projects/4612ac3b6eba4d9c8970ebfecab9c6b1/users/26a305bf12c94c779e022beee7585a56/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:57.828765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d2cc-7cb5-4a9c-bede-bbe78bbc33cd None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:57.829120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d2cc-7cb5-4a9c-bede-bbe78bbc33cd None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:57.829471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d2cc-7cb5-4a9c-bede-bbe78bbc33cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:57.868691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1d88d2cc-7cb5-4a9c-bede-bbe78bbc33cd None None] MFA Rules not processed for user `26a305bf12c94c779e022beee7585a56`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:57.869915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1d88d2cc-7cb5-4a9c-bede-bbe78bbc33cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:57.901173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:57.979452 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1077/2133] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:33:57.984156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acabc10-3cac-4419-b33e-c8bd82a9c0f7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:58.055057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acabc10-3cac-4419-b33e-c8bd82a9c0f7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:58.059757 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679167b-5e9a-4199-8ed0-52d09cda5c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:58.060430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679167b-5e9a-4199-8ed0-52d09cda5c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:58.060714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679167b-5e9a-4199-8ed0-52d09cda5c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:58.060993 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679167b-5e9a-4199-8ed0-52d09cda5c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:58.061688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679167b-5e9a-4199-8ed0-52d09cda5c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:58.063664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679167b-5e9a-4199-8ed0-52d09cda5c3a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:58.095141 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1057/2134] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:33:57 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:33:58.096723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88d2cc-7cb5-4a9c-bede-bbe78bbc33cd None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:58.110072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88d2cc-7cb5-4a9c-bede-bbe78bbc33cd None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:58.157242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f403a-131b-4f4e-848e-9be77b39c711 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:58.157534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f403a-131b-4f4e-848e-9be77b39c711 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:58.157817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f403a-131b-4f4e-848e-9be77b39c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:58.179347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5e604-de84-4e9f-8554-b6e3ebfe77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:58.180026 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5e604-de84-4e9f-8554-b6e3ebfe77db admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:58.180337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5e604-de84-4e9f-8554-b6e3ebfe77db admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:58.180614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5e604-de84-4e9f-8554-b6e3ebfe77db admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:58.181229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-978f403a-131b-4f4e-848e-9be77b39c711 None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:58.181442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5e604-de84-4e9f-8554-b6e3ebfe77db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:58.182555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-978f403a-131b-4f4e-848e-9be77b39c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:58.183416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5e604-de84-4e9f-8554-b6e3ebfe77db admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:58.212941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1078/2135] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:33:58 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:33:58.214109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5e604-de84-4e9f-8554-b6e3ebfe77db admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:58.224968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5e604-de84-4e9f-8554-b6e3ebfe77db admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:58.230679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678527-e099-4273-8e12-42552e0339d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:58.231567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678527-e099-4273-8e12-42552e0339d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:58.232049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678527-e099-4273-8e12-42552e0339d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:58.233033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09678527-e099-4273-8e12-42552e0339d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:58.233918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09678527-e099-4273-8e12-42552e0339d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:58.236850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09678527-e099-4273-8e12-42552e0339d3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:58.253989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1079/2136] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:33:58.257841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678527-e099-4273-8e12-42552e0339d3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:58.272714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1058/2137] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:58.280437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09678527-e099-4273-8e12-42552e0339d3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:58.285138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f403a-131b-4f4e-848e-9be77b39c711 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:58.286459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f2e22-ede6-4c83-979a-3f172ca27be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:58.286586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-978f403a-131b-4f4e-848e-9be77b39c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:58.287884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2e22-ede6-4c83-979a-3f172ca27be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:58.288351 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2e22-ede6-4c83-979a-3f172ca27be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:58.288871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2e22-ede6-4c83-979a-3f172ca27be7 admin admin] PATH_INFO: `/v3/projects/835efbad0920402db7bdbb67c9b0287f/users/388630793f404f07a88a2f7cdbe6a927/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:58.308107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f2e22-ede6-4c83-979a-3f172ca27be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835efbad0920402db7bdbb67c9b0287f, user_id=388630793f404f07a88a2f7cdbe6a927, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:58.311355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f2e22-ede6-4c83-979a-3f172ca27be7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:58.323351 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:58.327936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1080/2138] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:58 2022] PUT /identity/v3/projects/835efbad0920402db7bdbb67c9b0287f/users/388630793f404f07a88a2f7cdbe6a927/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:58.331685 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f2e22-ede6-4c83-979a-3f172ca27be7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:58.379192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f403a-131b-4f4e-848e-9be77b39c711 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:58.402675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f2e22-ede6-4c83-979a-3f172ca27be7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:58.407810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ae525-9a78-462f-abeb-b772f6adcb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:58.408518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ae525-9a78-462f-abeb-b772f6adcb4c admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:58.409022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ae525-9a78-462f-abeb-b772f6adcb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:58.409163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ae525-9a78-462f-abeb-b772f6adcb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:58.411070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ae525-9a78-462f-abeb-b772f6adcb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:58.411639 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ae525-9a78-462f-abeb-b772f6adcb4c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:58.422887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1081/2139] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:33:58.431379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ae525-9a78-462f-abeb-b772f6adcb4c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:58.442569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ae525-9a78-462f-abeb-b772f6adcb4c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:58.448337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b075bc-a701-44fa-8ce6-fedd699bc852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:58.449536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b075bc-a701-44fa-8ce6-fedd699bc852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:58.449933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b075bc-a701-44fa-8ce6-fedd699bc852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:58.450219 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b075bc-a701-44fa-8ce6-fedd699bc852 admin admin] PATH_INFO: `/v3/projects/835efbad0920402db7bdbb67c9b0287f/users/388630793f404f07a88a2f7cdbe6a927/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:58.452453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b075bc-a701-44fa-8ce6-fedd699bc852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835efbad0920402db7bdbb67c9b0287f, user_id=388630793f404f07a88a2f7cdbe6a927, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:58.455200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803e08a-90b7-47c3-8672-58b8c1c6141f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:58.455332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b075bc-a701-44fa-8ce6-fedd699bc852 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:58.456222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e08a-90b7-47c3-8672-58b8c1c6141f service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:58.456222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e08a-90b7-47c3-8672-58b8c1c6141f service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:58.456490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e08a-90b7-47c3-8672-58b8c1c6141f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:58.464213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:58.473255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1082/2140] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:33:58 2022] PUT /identity/v3/projects/835efbad0920402db7bdbb67c9b0287f/users/388630793f404f07a88a2f7cdbe6a927/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:33:58.481673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8e02a-b7b4-4640-be4b-03eeea0c241c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:58.482223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8e02a-b7b4-4640-be4b-03eeea0c241c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:58.483550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8e02a-b7b4-4640-be4b-03eeea0c241c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:58.522607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-28a8e02a-b7b4-4640-be4b-03eeea0c241c None None] MFA Rules not processed for user `388630793f404f07a88a2f7cdbe6a927`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:33:58.525117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-28a8e02a-b7b4-4640-be4b-03eeea0c241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:58.535911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803e08a-90b7-47c3-8672-58b8c1c6141f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:58.537210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803e08a-90b7-47c3-8672-58b8c1c6141f service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:58.548294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1059/2141] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:33:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 10:33:58.667162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1083/2142] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:33:58.687695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803e08a-90b7-47c3-8672-58b8c1c6141f service swift] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:33:58.689769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e803e08a-90b7-47c3-8672-58b8c1c6141f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:33:58.777071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803e08a-90b7-47c3-8672-58b8c1c6141f service swift] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:33:58.818640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:33:58.866675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ce906-14e5-463a-ad81-bae091e03d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:33:58.867555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ce906-14e5-463a-ad81-bae091e03d68 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:33:58.867840 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ce906-14e5-463a-ad81-bae091e03d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:33:58.868181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ce906-14e5-463a-ad81-bae091e03d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:33:58.961835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ce906-14e5-463a-ad81-bae091e03d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:33:58.963321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ce906-14e5-463a-ad81-bae091e03d68 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:33:58.988967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1060/2143] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:33:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:34:02.808694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8e02a-b7b4-4640-be4b-03eeea0c241c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:02.827743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8e02a-b7b4-4640-be4b-03eeea0c241c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:02.831752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9ab0-01a7-47f8-9870-8ff3afc7c621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:02.832451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9ab0-01a7-47f8-9870-8ff3afc7c621 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:02.832737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9ab0-01a7-47f8-9870-8ff3afc7c621 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:02.833015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9ab0-01a7-47f8-9870-8ff3afc7c621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:02.912657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9ab0-01a7-47f8-9870-8ff3afc7c621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:02.914268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9ab0-01a7-47f8-9870-8ff3afc7c621 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:02.924180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1084/2144] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:34:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:34:03.506579 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ce906-14e5-463a-ad81-bae091e03d68 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:03.515072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ce906-14e5-463a-ad81-bae091e03d68 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:03.518909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862aba9-f809-4fb3-8083-80eaf7daaa71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:03.519622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862aba9-f809-4fb3-8083-80eaf7daaa71 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:03.519858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862aba9-f809-4fb3-8083-80eaf7daaa71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:03.520133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862aba9-f809-4fb3-8083-80eaf7daaa71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:03.529290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862aba9-f809-4fb3-8083-80eaf7daaa71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:03.530756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862aba9-f809-4fb3-8083-80eaf7daaa71 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:03.540218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1061/2145] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:34:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:34:08.499569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9ab0-01a7-47f8-9870-8ff3afc7c621 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:08.565718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9ab0-01a7-47f8-9870-8ff3afc7c621 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:08.571812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:08.572677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:08.572964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:08.573247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] PATH_INFO: `/v3/users/c56b9e9fb41f41ea93e030b100b19e6e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:08.574901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56b9e9fb41f41ea93e030b100b19e6e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:08.576443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:08.609220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:08.636768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56b9e9fb41f41ea93e030b100b19e6e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:08.637521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56b9e9fb41f41ea93e030b100b19e6e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:08.645731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56b9e9fb41f41ea93e030b100b19e6e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:08.657997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56b9e9fb41f41ea93e030b100b19e6e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:08.664792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56b9e9fb41f41ea93e030b100b19e6e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:08.670716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1085/2146] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:34:08 2022] DELETE /identity/v3/users/c56b9e9fb41f41ea93e030b100b19e6e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:08.675252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea09a2-21a6-4cc3-9ac0-c5a32f4fbb86 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:08.675788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea09a2-21a6-4cc3-9ac0-c5a32f4fbb86 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:08.675961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea09a2-21a6-4cc3-9ac0-c5a32f4fbb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:08.693671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-18ea09a2-21a6-4cc3-9ac0-c5a32f4fbb86 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:08.694915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-18ea09a2-21a6-4cc3-9ac0-c5a32f4fbb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:08.759771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1062/2147] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:34:08.769558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:08.771628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:08.827858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2e20-85f7-407b-9888-3d36d311494e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:08.831363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74de3-54aa-4b7b-9958-792f15072b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:08.831997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74de3-54aa-4b7b-9958-792f15072b38 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:08.832279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74de3-54aa-4b7b-9958-792f15072b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:08.833089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74de3-54aa-4b7b-9958-792f15072b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:08.842020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b74de3-54aa-4b7b-9958-792f15072b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:08.843470 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b74de3-54aa-4b7b-9958-792f15072b38 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:08.855250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1086/2148] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:34:09.302652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea09a2-21a6-4cc3-9ac0-c5a32f4fbb86 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:09.308015 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-18ea09a2-21a6-4cc3-9ac0-c5a32f4fbb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:09.337187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea09a2-21a6-4cc3-9ac0-c5a32f4fbb86 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:09.343519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:09.345239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:09.345646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:09.346204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] PATH_INFO: `/v3/projects/152ebabdbffb49a2b68c5c693f1ec44b` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:09.347894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] RBAC: Authorizing `identity:delete_project(project_id=152ebabdbffb49a2b68c5c693f1ec44b)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:09.350625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:09.402718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152ebabdbffb49a2b68c5c693f1ec44b', 'request_id': 'req-0397f6c0-5272-498b-9e92-f1fe5a1d579e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:09.408275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152ebabdbffb49a2b68c5c693f1ec44b', 'request_id': 'req-0397f6c0-5272-498b-9e92-f1fe5a1d579e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:09.414733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152ebabdbffb49a2b68c5c693f1ec44b', 'request_id': 'req-0397f6c0-5272-498b-9e92-f1fe5a1d579e'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:09.416435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:09.429473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] The token cache is being invalidate because project 152ebabdbffb49a2b68c5c693f1ec44b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:34:09.429824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:09.430463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:09.432714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1063/2149] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:34:09 2022] DELETE /identity/v3/projects/152ebabdbffb49a2b68c5c693f1ec44b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:09.436532 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74de3-54aa-4b7b-9958-792f15072b38 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:09.447180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74de3-54aa-4b7b-9958-792f15072b38 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:09.505978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:09.507053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:09.507179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:09.507465 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] PATH_INFO: `/v3/users/26a305bf12c94c779e022beee7585a56` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:09.508655 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a305bf12c94c779e022beee7585a56)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:09.510853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:09.572154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a305bf12c94c779e022beee7585a56'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:09.573039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a305bf12c94c779e022beee7585a56'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:09.579814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:09.587092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a305bf12c94c779e022beee7585a56'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:09.602397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a305bf12c94c779e022beee7585a56'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:09.610338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a305bf12c94c779e022beee7585a56'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:09.617267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1087/2150] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:34:09 2022] DELETE /identity/v3/users/26a305bf12c94c779e022beee7585a56 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:09.913884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:09.915585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:09.929753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397f6c0-5272-498b-9e92-f1fe5a1d579e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:10.019852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:10.021199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:10.021481 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:10.021757 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] PATH_INFO: `/v3/projects/4612ac3b6eba4d9c8970ebfecab9c6b1` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:10.023002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4612ac3b6eba4d9c8970ebfecab9c6b1)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:10.024907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:10.080936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4612ac3b6eba4d9c8970ebfecab9c6b1', 'request_id': 'req-79587434-52cd-400b-a115-37844814d4b9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.088276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4612ac3b6eba4d9c8970ebfecab9c6b1', 'request_id': 'req-79587434-52cd-400b-a115-37844814d4b9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.096217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4612ac3b6eba4d9c8970ebfecab9c6b1', 'request_id': 'req-79587434-52cd-400b-a115-37844814d4b9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.111049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] The token cache is being invalidate because project 4612ac3b6eba4d9c8970ebfecab9c6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:34:10.111467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.112170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.114617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1064/2151] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:34:09 2022] DELETE /identity/v3/projects/4612ac3b6eba4d9c8970ebfecab9c6b1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:10.118533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:10.119917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:10.133025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1404be7-f13b-4ffe-8b50-dc252ca44ba9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:10.211097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:10.211975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:10.212269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:10.212548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] PATH_INFO: `/v3/users/388630793f404f07a88a2f7cdbe6a927` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:10.213815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388630793f404f07a88a2f7cdbe6a927)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:10.215781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:10.264139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388630793f404f07a88a2f7cdbe6a927'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.264930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388630793f404f07a88a2f7cdbe6a927'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.284573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388630793f404f07a88a2f7cdbe6a927'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.299370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388630793f404f07a88a2f7cdbe6a927'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.306763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b1f5cf73-58ce-4e1a-bb72-db31f050f908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388630793f404f07a88a2f7cdbe6a927'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.312745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1088/2152] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:34:10 2022] DELETE /identity/v3/users/388630793f404f07a88a2f7cdbe6a927 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:10.748462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:10.750034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:10.763959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587434-52cd-400b-a115-37844814d4b9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:10.822228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:10.823060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:10.823350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:10.823629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] PATH_INFO: `/v3/projects/835efbad0920402db7bdbb67c9b0287f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:10.824834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=835efbad0920402db7bdbb67c9b0287f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:10.826790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:10.850926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:10.873534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835efbad0920402db7bdbb67c9b0287f', 'request_id': 'req-5ede6d88-9eab-4b56-84fe-e962708cb269'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.878955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835efbad0920402db7bdbb67c9b0287f', 'request_id': 'req-5ede6d88-9eab-4b56-84fe-e962708cb269'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.885483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835efbad0920402db7bdbb67c9b0287f', 'request_id': 'req-5ede6d88-9eab-4b56-84fe-e962708cb269'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.897691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] The token cache is being invalidate because project 835efbad0920402db7bdbb67c9b0287f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:34:10.897973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.898616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5ede6d88-9eab-4b56-84fe-e962708cb269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:10.900185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1065/2153] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:34:10 2022] DELETE /identity/v3/projects/835efbad0920402db7bdbb67c9b0287f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:10.905007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfe784-f420-4b7d-b662-e545604da0c8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:10.905459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfe784-f420-4b7d-b662-e545604da0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:10.905584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfe784-f420-4b7d-b662-e545604da0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:10.923768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-89cfe784-f420-4b7d-b662-e545604da0c8 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:10.924951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-89cfe784-f420-4b7d-b662-e545604da0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:10.964461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:10.985247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1089/2154] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:10.994180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b95dc9-3d9b-4582-93db-84517c4d9606 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:10.994689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b95dc9-3d9b-4582-93db-84517c4d9606 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:10.994802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b95dc9-3d9b-4582-93db-84517c4d9606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:11.012615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-20b95dc9-3d9b-4582-93db-84517c4d9606 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:11.013822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-20b95dc9-3d9b-4582-93db-84517c4d9606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:11.022239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1066/2155] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:11.026273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfe784-f420-4b7d-b662-e545604da0c8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:11.036608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfe784-f420-4b7d-b662-e545604da0c8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:11.041164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f867157-d33b-4806-b834-edd838a47f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:11.041812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f867157-d33b-4806-b834-edd838a47f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:11.042098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f867157-d33b-4806-b834-edd838a47f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:11.042404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f867157-d33b-4806-b834-edd838a47f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:11.043134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f867157-d33b-4806-b834-edd838a47f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:34:11.043445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f867157-d33b-4806-b834-edd838a47f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:11.045034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f867157-d33b-4806-b834-edd838a47f92 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:11.056488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1090/2156] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:34:11.060535 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b95dc9-3d9b-4582-93db-84517c4d9606 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:11.069639 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b95dc9-3d9b-4582-93db-84517c4d9606 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:11.074468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff069e-12c4-402b-afc5-43c3bec0eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:11.075059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff069e-12c4-402b-afc5-43c3bec0eb5b admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:11.075349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff069e-12c4-402b-afc5-43c3bec0eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:11.075626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff069e-12c4-402b-afc5-43c3bec0eb5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:11.076314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff069e-12c4-402b-afc5-43c3bec0eb5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:11.078204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff069e-12c4-402b-afc5-43c3bec0eb5b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:11.104517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1067/2157] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:34:11 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:34:11.108481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f867157-d33b-4806-b834-edd838a47f92 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:11.118546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f867157-d33b-4806-b834-edd838a47f92 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:11.174498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fae52c-22a6-4a49-8abd-4fa9d368a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:11.175151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fae52c-22a6-4a49-8abd-4fa9d368a1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:11.175432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fae52c-22a6-4a49-8abd-4fa9d368a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:11.175705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fae52c-22a6-4a49-8abd-4fa9d368a1f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:11.176377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fae52c-22a6-4a49-8abd-4fa9d368a1f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:11.178278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fae52c-22a6-4a49-8abd-4fa9d368a1f7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:11.198253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1091/2158] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:34:11 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:34:11.201808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff069e-12c4-402b-afc5-43c3bec0eb5b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:11.212556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff069e-12c4-402b-afc5-43c3bec0eb5b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:11.217162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df6d1-2cb9-4840-9232-3b0d45a72d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:11.217811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df6d1-2cb9-4840-9232-3b0d45a72d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:11.218101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df6d1-2cb9-4840-9232-3b0d45a72d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:11.218413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df6d1-2cb9-4840-9232-3b0d45a72d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:11.219141 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41df6d1-2cb9-4840-9232-3b0d45a72d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:11.220732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41df6d1-2cb9-4840-9232-3b0d45a72d23 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:11.231514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1068/2159] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:34:11.235249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fae52c-22a6-4a49-8abd-4fa9d368a1f7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:11.245924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fae52c-22a6-4a49-8abd-4fa9d368a1f7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:11.250486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c70a29-19f7-4e53-9528-bcf5950bf25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:11.251244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c70a29-19f7-4e53-9528-bcf5950bf25c admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:11.251555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c70a29-19f7-4e53-9528-bcf5950bf25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:11.252008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c70a29-19f7-4e53-9528-bcf5950bf25c admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:11.252823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c70a29-19f7-4e53-9528-bcf5950bf25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:11.254688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c70a29-19f7-4e53-9528-bcf5950bf25c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:11.267773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1092/2160] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:34:11.272228 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df6d1-2cb9-4840-9232-3b0d45a72d23 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:11.283929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df6d1-2cb9-4840-9232-3b0d45a72d23 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:11.289264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04f6c-097b-46b9-b6a2-fc6d530317d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:11.290139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04f6c-097b-46b9-b6a2-fc6d530317d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:11.290459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04f6c-097b-46b9-b6a2-fc6d530317d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:11.290743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04f6c-097b-46b9-b6a2-fc6d530317d8 admin admin] PATH_INFO: `/v3/projects/2cd4173e1cd549a3b5f1c98983d91bfb/users/2b628f74bb4148a59aeca2c27b6cc2c0/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:11.307861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d04f6c-097b-46b9-b6a2-fc6d530317d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd4173e1cd549a3b5f1c98983d91bfb, user_id=2b628f74bb4148a59aeca2c27b6cc2c0, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:11.310273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d04f6c-097b-46b9-b6a2-fc6d530317d8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:11.323034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1069/2161] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:34:11 2022] PUT /identity/v3/projects/2cd4173e1cd549a3b5f1c98983d91bfb/users/2b628f74bb4148a59aeca2c27b6cc2c0/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:11.328357 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dadee-f82e-4817-a708-f020cde76c3a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:11.328592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dadee-f82e-4817-a708-f020cde76c3a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:11.328874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dadee-f82e-4817-a708-f020cde76c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:11.346180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a82dadee-f82e-4817-a708-f020cde76c3a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:11.347459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a82dadee-f82e-4817-a708-f020cde76c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:11.408748 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1093/2162] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:11.418913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04f6c-097b-46b9-b6a2-fc6d530317d8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:11.420602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-34d04f6c-097b-46b9-b6a2-fc6d530317d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:11.476963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04f6c-097b-46b9-b6a2-fc6d530317d8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:11.480597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad8783-965b-479e-beb2-0e6e01115eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:11.481244 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad8783-965b-479e-beb2-0e6e01115eaf service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:11.481534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad8783-965b-479e-beb2-0e6e01115eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:11.481815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad8783-965b-479e-beb2-0e6e01115eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:11.491521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad8783-965b-479e-beb2-0e6e01115eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:11.492951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad8783-965b-479e-beb2-0e6e01115eaf service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:11.502340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1070/2163] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:34:12.246257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd485c6-139f-4096-8cfb-3f8394f8128a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:12.246747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd485c6-139f-4096-8cfb-3f8394f8128a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:12.246930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd485c6-139f-4096-8cfb-3f8394f8128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:12.275934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-acd485c6-139f-4096-8cfb-3f8394f8128a None None] MFA Rules not processed for user `2b628f74bb4148a59aeca2c27b6cc2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:12.276947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-acd485c6-139f-4096-8cfb-3f8394f8128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:12.320438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:12.352568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1094/2164] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:12.361835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad8783-965b-479e-beb2-0e6e01115eaf service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:12.363603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-96ad8783-965b-479e-beb2-0e6e01115eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:12.422692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad8783-965b-479e-beb2-0e6e01115eaf service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:12.426231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788939c-73b3-4a57-aede-ee0a8a48dc82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:12.426920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788939c-73b3-4a57-aede-ee0a8a48dc82 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:12.427203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788939c-73b3-4a57-aede-ee0a8a48dc82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:12.428041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788939c-73b3-4a57-aede-ee0a8a48dc82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:12.433581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:12.437539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788939c-73b3-4a57-aede-ee0a8a48dc82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:12.439749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788939c-73b3-4a57-aede-ee0a8a48dc82 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:12.449895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1071/2165] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:34:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:34:13.783628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9a19c-05d2-43ca-b04f-4181d7f0451d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:13.784180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9a19c-05d2-43ca-b04f-4181d7f0451d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:13.784304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9a19c-05d2-43ca-b04f-4181d7f0451d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:13.802374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1db9a19c-05d2-43ca-b04f-4181d7f0451d None None] MFA Rules not processed for user `2b628f74bb4148a59aeca2c27b6cc2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:13.803563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1db9a19c-05d2-43ca-b04f-4181d7f0451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:13.810245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1095/2166] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:16.806748 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788939c-73b3-4a57-aede-ee0a8a48dc82 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:16.808653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e788939c-73b3-4a57-aede-ee0a8a48dc82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:16.824903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788939c-73b3-4a57-aede-ee0a8a48dc82 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:16.830762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:16.832064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:16.832328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:16.832703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] PATH_INFO: `/v3/users/0d6f99cfc1624f489251c0d0e72fdd29` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:16.834831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6f99cfc1624f489251c0d0e72fdd29)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:16.838130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:16.894516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6f99cfc1624f489251c0d0e72fdd29'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:16.895189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6f99cfc1624f489251c0d0e72fdd29'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:16.895830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6f99cfc1624f489251c0d0e72fdd29'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:16.911713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6f99cfc1624f489251c0d0e72fdd29'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:16.919981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6f99cfc1624f489251c0d0e72fdd29'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:16.934937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1072/2167] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:34:16 2022] DELETE /identity/v3/users/0d6f99cfc1624f489251c0d0e72fdd29 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:16.939317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34aca8-3deb-4f16-8e60-95f7720c2918 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:16.939731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34aca8-3deb-4f16-8e60-95f7720c2918 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:16.939895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34aca8-3deb-4f16-8e60-95f7720c2918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:16.959391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7b34aca8-3deb-4f16-8e60-95f7720c2918 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:16.968826 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7b34aca8-3deb-4f16-8e60-95f7720c2918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:17.025303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1096/2168] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:34:17.034903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:17.036321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:17.094076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060c12-cf34-4c9f-9bfb-d31117b2451c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:17.097585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d61a9f-abc0-49d7-8e79-eb2829291157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:17.098231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d61a9f-abc0-49d7-8e79-eb2829291157 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.098541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d61a9f-abc0-49d7-8e79-eb2829291157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.098822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d61a9f-abc0-49d7-8e79-eb2829291157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.108132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d61a9f-abc0-49d7-8e79-eb2829291157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:17.109552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d61a9f-abc0-49d7-8e79-eb2829291157 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:17.120039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1073/2169] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:34:17.380003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34aca8-3deb-4f16-8e60-95f7720c2918 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:17.381551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7b34aca8-3deb-4f16-8e60-95f7720c2918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:17.395132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34aca8-3deb-4f16-8e60-95f7720c2918 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:17.400049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:17.401018 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.401304 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.401584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] PATH_INFO: `/v3/projects/642028e2f4a34165a99b3411c2788f76` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.402964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] RBAC: Authorizing `identity:delete_project(project_id=642028e2f4a34165a99b3411c2788f76)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:17.405052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:17.451977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '642028e2f4a34165a99b3411c2788f76', 'request_id': 'req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:17.458703 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '642028e2f4a34165a99b3411c2788f76', 'request_id': 'req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:17.464318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '642028e2f4a34165a99b3411c2788f76', 'request_id': 'req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:17.476233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] The token cache is being invalidate because project 642028e2f4a34165a99b3411c2788f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:34:17.476534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:17.477182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6c41283d-1635-4b4b-bdf2-0fe5f4cd333e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:34:17.478770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1097/2170] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:34:17 2022] DELETE /identity/v3/projects/642028e2f4a34165a99b3411c2788f76 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:17.483909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790af76-43db-4c1f-8104-c3c5d468349c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.484279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790af76-43db-4c1f-8104-c3c5d468349c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.484566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790af76-43db-4c1f-8104-c3c5d468349c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.504874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0790af76-43db-4c1f-8104-c3c5d468349c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:17.506186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0790af76-43db-4c1f-8104-c3c5d468349c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:17.570438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1074/2171] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:34:17.576632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a67f3-30d5-4261-8b49-21b6ef664742 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.576984 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a67f3-30d5-4261-8b49-21b6ef664742 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.577340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a67f3-30d5-4261-8b49-21b6ef664742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.611125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a20a67f3-30d5-4261-8b49-21b6ef664742 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:17.614871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a20a67f3-30d5-4261-8b49-21b6ef664742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:17.629225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1098/2172] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:17.630427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790af76-43db-4c1f-8104-c3c5d468349c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:17.641095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790af76-43db-4c1f-8104-c3c5d468349c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:17.646198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc8a62-fcc2-4d35-be31-5da747714dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:17.647418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc8a62-fcc2-4d35-be31-5da747714dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.647708 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc8a62-fcc2-4d35-be31-5da747714dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.647987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc8a62-fcc2-4d35-be31-5da747714dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.648769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc8a62-fcc2-4d35-be31-5da747714dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:34:17.649094 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc8a62-fcc2-4d35-be31-5da747714dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:17.650753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc8a62-fcc2-4d35-be31-5da747714dcc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:17.654523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:17.667366 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1075/2173] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:34:17.671285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a67f3-30d5-4261-8b49-21b6ef664742 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:17.681084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a67f3-30d5-4261-8b49-21b6ef664742 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:17.686713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb40302-c08b-4e55-8f94-9d9269c3b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:17.688541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb40302-c08b-4e55-8f94-9d9269c3b843 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.688541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb40302-c08b-4e55-8f94-9d9269c3b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.689177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb40302-c08b-4e55-8f94-9d9269c3b843 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.689985 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb40302-c08b-4e55-8f94-9d9269c3b843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:17.692040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb40302-c08b-4e55-8f94-9d9269c3b843 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:17.722706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1099/2174] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:34:17 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:34:17.727216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc8a62-fcc2-4d35-be31-5da747714dcc admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:17.738382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc8a62-fcc2-4d35-be31-5da747714dcc admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:17.804501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a8615-f505-4cde-8257-a279d4774161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:17.805319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8615-f505-4cde-8257-a279d4774161 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.805615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8615-f505-4cde-8257-a279d4774161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.805899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8615-f505-4cde-8257-a279d4774161 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.806679 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a8615-f505-4cde-8257-a279d4774161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:17.808611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a8615-f505-4cde-8257-a279d4774161 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:17.833629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1076/2175] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:34:17 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:34:17.835698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb40302-c08b-4e55-8f94-9d9269c3b843 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:17.846252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb40302-c08b-4e55-8f94-9d9269c3b843 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:17.851635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec1ccc-2c6a-4f59-887c-bcdee8186008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:17.852294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec1ccc-2c6a-4f59-887c-bcdee8186008 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.852576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec1ccc-2c6a-4f59-887c-bcdee8186008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.852850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec1ccc-2c6a-4f59-887c-bcdee8186008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.853578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec1ccc-2c6a-4f59-887c-bcdee8186008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:17.855237 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec1ccc-2c6a-4f59-887c-bcdee8186008 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:17.866276 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1100/2176] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:34:17.870190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a8615-f505-4cde-8257-a279d4774161 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:17.880383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a8615-f505-4cde-8257-a279d4774161 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:17.885554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a53aee-bcc0-480c-b6bc-76c2d03a57d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:17.886207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a53aee-bcc0-480c-b6bc-76c2d03a57d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.886526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a53aee-bcc0-480c-b6bc-76c2d03a57d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.886801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a53aee-bcc0-480c-b6bc-76c2d03a57d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.887554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a53aee-bcc0-480c-b6bc-76c2d03a57d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:17.889130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a53aee-bcc0-480c-b6bc-76c2d03a57d3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:17.900355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1077/2177] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:34:17.904662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec1ccc-2c6a-4f59-887c-bcdee8186008 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:17.914994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec1ccc-2c6a-4f59-887c-bcdee8186008 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:17.919724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5cd9f-c793-49d8-918f-e903afc26afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:17.920612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5cd9f-c793-49d8-918f-e903afc26afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.920899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5cd9f-c793-49d8-918f-e903afc26afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.921183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5cd9f-c793-49d8-918f-e903afc26afe admin admin] PATH_INFO: `/v3/projects/a3f83cae6ac14066855acb39b99294e7/users/9046f8fd0c484c2990a32f91176f1764/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.938985 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5cd9f-c793-49d8-918f-e903afc26afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f83cae6ac14066855acb39b99294e7, user_id=9046f8fd0c484c2990a32f91176f1764, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:17.941968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5cd9f-c793-49d8-918f-e903afc26afe admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:17.944793 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:17.960674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1101/2178] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:34:17 2022] PUT /identity/v3/projects/a3f83cae6ac14066855acb39b99294e7/users/9046f8fd0c484c2990a32f91176f1764/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:17.965614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a02ce-f612-4641-89e8-f8a2edecce09 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:17.965957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a02ce-f612-4641-89e8-f8a2edecce09 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:17.966179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a02ce-f612-4641-89e8-f8a2edecce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:17.994904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ba5a02ce-f612-4641-89e8-f8a2edecce09 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:17.996740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ba5a02ce-f612-4641-89e8-f8a2edecce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:18.073117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1078/2179] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:18.089214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5cd9f-c793-49d8-918f-e903afc26afe admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:18.091596 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-70c5cd9f-c793-49d8-918f-e903afc26afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:18.161401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5cd9f-c793-49d8-918f-e903afc26afe admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:18.165224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fc98b-b32b-43f3-9ec4-3976fbccb296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:18.166062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fc98b-b32b-43f3-9ec4-3976fbccb296 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:18.166488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fc98b-b32b-43f3-9ec4-3976fbccb296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:18.166869 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fc98b-b32b-43f3-9ec4-3976fbccb296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:18.177782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fc98b-b32b-43f3-9ec4-3976fbccb296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:18.179419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fc98b-b32b-43f3-9ec4-3976fbccb296 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:18.191205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1102/2180] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:34:23.350830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d042570-ab37-454a-ae3a-b1eb6e0cfbb2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:23.351943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d042570-ab37-454a-ae3a-b1eb6e0cfbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:23.352418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d042570-ab37-454a-ae3a-b1eb6e0cfbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:23.405259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8d042570-ab37-454a-ae3a-b1eb6e0cfbb2 None None] MFA Rules not processed for user `9046f8fd0c484c2990a32f91176f1764`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:23.406478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8d042570-ab37-454a-ae3a-b1eb6e0cfbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:23.512692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1079/2181] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:23.517510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fc98b-b32b-43f3-9ec4-3976fbccb296 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:23.544886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fc98b-b32b-43f3-9ec4-3976fbccb296 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:23.563858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1411a57-aa27-4e77-baa1-c4d5099c245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:23.564006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1411a57-aa27-4e77-baa1-c4d5099c245b admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:23.564194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1411a57-aa27-4e77-baa1-c4d5099c245b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:23.564546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1411a57-aa27-4e77-baa1-c4d5099c245b admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:23.573944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1411a57-aa27-4e77-baa1-c4d5099c245b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:23.575989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1411a57-aa27-4e77-baa1-c4d5099c245b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:23.622780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1103/2182] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:34:23 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:34:23.626517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d042570-ab37-454a-ae3a-b1eb6e0cfbb2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:23.635543 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:23.639664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d042570-ab37-454a-ae3a-b1eb6e0cfbb2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:23.730645 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c281e8-5069-4d59-aede-427bcf8f683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:23.740588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c281e8-5069-4d59-aede-427bcf8f683a admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:23.740895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c281e8-5069-4d59-aede-427bcf8f683a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:23.741181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c281e8-5069-4d59-aede-427bcf8f683a admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:23.741975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c281e8-5069-4d59-aede-427bcf8f683a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:23.743970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c281e8-5069-4d59-aede-427bcf8f683a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:23.773539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1080/2183] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:34:23 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:34:23.774259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1411a57-aa27-4e77-baa1-c4d5099c245b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:23.786453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1411a57-aa27-4e77-baa1-c4d5099c245b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:23.791845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c895673-cb3b-4752-b569-9f38ece8bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:23.792709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895673-cb3b-4752-b569-9f38ece8bb36 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:23.793233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895673-cb3b-4752-b569-9f38ece8bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:23.793699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895673-cb3b-4752-b569-9f38ece8bb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:23.794628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c895673-cb3b-4752-b569-9f38ece8bb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:23.799370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c895673-cb3b-4752-b569-9f38ece8bb36 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:23.820744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1104/2184] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:34:23.825672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c281e8-5069-4d59-aede-427bcf8f683a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:23.855290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c281e8-5069-4d59-aede-427bcf8f683a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:23.861370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b6cf4-1ecc-451e-b2d6-1d1530ddf678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:23.862263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b6cf4-1ecc-451e-b2d6-1d1530ddf678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:23.862601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b6cf4-1ecc-451e-b2d6-1d1530ddf678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:23.863302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b6cf4-1ecc-451e-b2d6-1d1530ddf678 admin admin] PATH_INFO: `/v3/projects/6cd33a7ec91b4cc288fd18191331bf23/users/579f79ddf6574d2dbb89e4497468ccdf/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:23.883806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b6cf4-1ecc-451e-b2d6-1d1530ddf678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd33a7ec91b4cc288fd18191331bf23, user_id=579f79ddf6574d2dbb89e4497468ccdf, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:23.886517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b6cf4-1ecc-451e-b2d6-1d1530ddf678 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:23.906098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1081/2185] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:34:23 2022] PUT /identity/v3/projects/6cd33a7ec91b4cc288fd18191331bf23/users/579f79ddf6574d2dbb89e4497468ccdf/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:23.910559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c895673-cb3b-4752-b569-9f38ece8bb36 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:23.925794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c895673-cb3b-4752-b569-9f38ece8bb36 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:24.021985 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303c0ce-719b-4e39-b303-da363c552715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:24.022807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303c0ce-719b-4e39-b303-da363c552715 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:24.023166 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303c0ce-719b-4e39-b303-da363c552715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:24.023519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303c0ce-719b-4e39-b303-da363c552715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:24.024326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303c0ce-719b-4e39-b303-da363c552715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:24.026029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303c0ce-719b-4e39-b303-da363c552715 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:24.036228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1105/2186] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:34:24.040490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b6cf4-1ecc-451e-b2d6-1d1530ddf678 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:24.051068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b6cf4-1ecc-451e-b2d6-1d1530ddf678 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:24.056065 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa99bb-818f-473b-abb0-93701659d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:24.057044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa99bb-818f-473b-abb0-93701659d9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:24.057308 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa99bb-818f-473b-abb0-93701659d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:24.057603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa99bb-818f-473b-abb0-93701659d9e3 admin admin] PATH_INFO: `/v3/projects/6cd33a7ec91b4cc288fd18191331bf23/users/579f79ddf6574d2dbb89e4497468ccdf/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:24.059738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa99bb-818f-473b-abb0-93701659d9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd33a7ec91b4cc288fd18191331bf23, user_id=579f79ddf6574d2dbb89e4497468ccdf, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:24.063302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa99bb-818f-473b-abb0-93701659d9e3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:24.075353 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1082/2187] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:34:24 2022] PUT /identity/v3/projects/6cd33a7ec91b4cc288fd18191331bf23/users/579f79ddf6574d2dbb89e4497468ccdf/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:34:30.143895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2309a17-9340-4ebc-a03c-66649609f6d5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:30.144433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2309a17-9340-4ebc-a03c-66649609f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:30.144433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2309a17-9340-4ebc-a03c-66649609f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:30.201519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b2309a17-9340-4ebc-a03c-66649609f6d5 None None] MFA Rules not processed for user `579f79ddf6574d2dbb89e4497468ccdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:30.203246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b2309a17-9340-4ebc-a03c-66649609f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:30.270782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:30.296851 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1106/2188] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:30.310036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa99bb-818f-473b-abb0-93701659d9e3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:30.312223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dcfa99bb-818f-473b-abb0-93701659d9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:30.394858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa99bb-818f-473b-abb0-93701659d9e3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:30.401072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969d784-aaa4-4b8d-ad79-fd325732bd6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:30.401721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d784-aaa4-4b8d-ad79-fd325732bd6f service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:30.402038 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d784-aaa4-4b8d-ad79-fd325732bd6f service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:30.402317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d784-aaa4-4b8d-ad79-fd325732bd6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:30.456457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:30.461330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969d784-aaa4-4b8d-ad79-fd325732bd6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:30.463012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969d784-aaa4-4b8d-ad79-fd325732bd6f service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:30.472799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1083/2189] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:34:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:34:31.814313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e32be-17b6-4cca-a937-173d25d05ad9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:31.814909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e32be-17b6-4cca-a937-173d25d05ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:31.815182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e32be-17b6-4cca-a937-173d25d05ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:31.836491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-803e32be-17b6-4cca-a937-173d25d05ad9 None None] MFA Rules not processed for user `9046f8fd0c484c2990a32f91176f1764`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:31.838241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-803e32be-17b6-4cca-a937-173d25d05ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:31.846155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1107/2190] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:36.849381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969d784-aaa4-4b8d-ad79-fd325732bd6f service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:34:36.851331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8969d784-aaa4-4b8d-ad79-fd325732bd6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:36.908575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969d784-aaa4-4b8d-ad79-fd325732bd6f service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:34:36.912093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45c145-1ca7-4d5d-81d0-38140fe6e7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:34:36.912738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45c145-1ca7-4d5d-81d0-38140fe6e7af service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:36.913020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45c145-1ca7-4d5d-81d0-38140fe6e7af service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:36.913296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45c145-1ca7-4d5d-81d0-38140fe6e7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:36.915066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ca45c145-1ca7-4d5d-81d0-38140fe6e7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:36.977638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45c145-1ca7-4d5d-81d0-38140fe6e7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:34:36.979024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45c145-1ca7-4d5d-81d0-38140fe6e7af service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:34:36.990447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1084/2191] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:34:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:34:39.883340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dee03-dd27-4312-b4a9-53764a1907e2 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:34:39.883900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dee03-dd27-4312-b4a9-53764a1907e2 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:34:39.883900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dee03-dd27-4312-b4a9-53764a1907e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:34:39.903072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-bd7dee03-dd27-4312-b4a9-53764a1907e2 None None] MFA Rules not processed for user `2b628f74bb4148a59aeca2c27b6cc2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:34:39.904302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bd7dee03-dd27-4312-b4a9-53764a1907e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:34:39.981862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1108/2192] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:34:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:34:46.984554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=53 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:34:49.974606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=35 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:00.280102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3573fa-319a-47b6-99c6-7b4ba9981a23 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:00.280654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3573fa-319a-47b6-99c6-7b4ba9981a23 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:00.280654 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3573fa-319a-47b6-99c6-7b4ba9981a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:00.310045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-0f3573fa-319a-47b6-99c6-7b4ba9981a23 None None] MFA Rules not processed for user `6e971595d77647dca5a29a5574c6627d`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:00.311284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0f3573fa-319a-47b6-99c6-7b4ba9981a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:00.386790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1085/2193] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:04.157082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ca41-9675-4e6e-b025-ef37d9d8131e None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:04.157535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ca41-9675-4e6e-b025-ef37d9d8131e None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:04.157650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ca41-9675-4e6e-b025-ef37d9d8131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:04.186195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f5e7ca41-9675-4e6e-b025-ef37d9d8131e None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:04.187409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f5e7ca41-9675-4e6e-b025-ef37d9d8131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:04.259756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1109/2194] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:35:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:04.300676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3573fa-319a-47b6-99c6-7b4ba9981a23 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:04.302092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0f3573fa-319a-47b6-99c6-7b4ba9981a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:04.389981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3573fa-319a-47b6-99c6-7b4ba9981a23 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:04.395232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47501d8-d9eb-477e-9f88-92490e6ea5d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:04.395927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47501d8-d9eb-477e-9f88-92490e6ea5d9 service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:04.396269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47501d8-d9eb-477e-9f88-92490e6ea5d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:04.396553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47501d8-d9eb-477e-9f88-92490e6ea5d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:04.404688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47501d8-d9eb-477e-9f88-92490e6ea5d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:04.406258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47501d8-d9eb-477e-9f88-92490e6ea5d9 service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:04.415474 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1086/2195] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:35:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:35:14.252992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=36 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:14.411048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=72 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:16.792103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7ca41-9675-4e6e-b025-ef37d9d8131e None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:16.825189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7ca41-9675-4e6e-b025-ef37d9d8131e None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:16.830625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfff4d-1389-43aa-b322-692089e152b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:16.831711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfff4d-1389-43aa-b322-692089e152b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:16.832195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfff4d-1389-43aa-b322-692089e152b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:16.832665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfff4d-1389-43aa-b322-692089e152b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:16.845427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfff4d-1389-43aa-b322-692089e152b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:16.847928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfff4d-1389-43aa-b322-692089e152b5 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:16.867359 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1110/2196] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:35:16 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:35:20.911680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1162e39-5641-4558-9158-63947368f817 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:20.912188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1162e39-5641-4558-9158-63947368f817 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:20.912286 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1162e39-5641-4558-9158-63947368f817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:20.930781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f1162e39-5641-4558-9158-63947368f817 None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:20.931997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f1162e39-5641-4558-9158-63947368f817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:20.946718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1087/2197] 10.222.0.44 () {58 vars in 967 bytes} [Fri Jun 24 10:35:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:20.960365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfff4d-1389-43aa-b322-692089e152b5 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:20.971612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfff4d-1389-43aa-b322-692089e152b5 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:20.976610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471298cf-1d30-4477-b0ff-ae7c050cef7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:20.977251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471298cf-1d30-4477-b0ff-ae7c050cef7a service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:20.977533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471298cf-1d30-4477-b0ff-ae7c050cef7a service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:20.977811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471298cf-1d30-4477-b0ff-ae7c050cef7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:20.986664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471298cf-1d30-4477-b0ff-ae7c050cef7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:20.988514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471298cf-1d30-4477-b0ff-ae7c050cef7a service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:20.997188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1111/2198] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:35:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:35:22.269580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1162e39-5641-4558-9158-63947368f817 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:22.271172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f1162e39-5641-4558-9158-63947368f817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:22.381492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1162e39-5641-4558-9158-63947368f817 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:22.387669 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bc712-f900-423c-99b8-c0a6a32a442d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:22.388315 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bc712-f900-423c-99b8-c0a6a32a442d service placement] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:22.388595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bc712-f900-423c-99b8-c0a6a32a442d service placement] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:22.388870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bc712-f900-423c-99b8-c0a6a32a442d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:22.390711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-571bc712-f900-423c-99b8-c0a6a32a442d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:22.403038 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bc712-f900-423c-99b8-c0a6a32a442d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:22.404617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bc712-f900-423c-99b8-c0a6a32a442d service placement] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:22.421082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1088/2199] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:35:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:35:23.010036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471298cf-1d30-4477-b0ff-ae7c050cef7a service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:23.011538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-471298cf-1d30-4477-b0ff-ae7c050cef7a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:23.107233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471298cf-1d30-4477-b0ff-ae7c050cef7a service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:23.111786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:23.112878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.113164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.113700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] PATH_INFO: `/v3/users/2b628f74bb4148a59aeca2c27b6cc2c0` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:23.114960 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b628f74bb4148a59aeca2c27b6cc2c0)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:23.116890 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:23.162278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b628f74bb4148a59aeca2c27b6cc2c0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:23.162946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b628f74bb4148a59aeca2c27b6cc2c0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:23.171773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b628f74bb4148a59aeca2c27b6cc2c0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:23.184678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b628f74bb4148a59aeca2c27b6cc2c0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:23.191451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-f24f8677-963b-4289-af23-62456d0429b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b628f74bb4148a59aeca2c27b6cc2c0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:23.197315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1112/2200] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:35:23 2022] DELETE /identity/v3/users/2b628f74bb4148a59aeca2c27b6cc2c0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:35:23.367551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bc712-f900-423c-99b8-c0a6a32a442d service placement] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:23.378050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bc712-f900-423c-99b8-c0a6a32a442d service placement] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:23.436427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:23.437281 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.437565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.437840 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] PATH_INFO: `/v3/projects/2cd4173e1cd549a3b5f1c98983d91bfb` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:23.438996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd4173e1cd549a3b5f1c98983d91bfb)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:23.440890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:23.485331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd4173e1cd549a3b5f1c98983d91bfb', 'request_id': 'req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:23.491041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd4173e1cd549a3b5f1c98983d91bfb', 'request_id': 'req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:23.492183 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:23.500635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd4173e1cd549a3b5f1c98983d91bfb', 'request_id': 'req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:23.512408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] The token cache is being invalidate because project 2cd4173e1cd549a3b5f1c98983d91bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:35:23.512692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:23.513316 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-43b218a0-3c77-4ea8-96a0-b06a0e3cbddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:23.514895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1089/2201] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:35:23 2022] DELETE /identity/v3/projects/2cd4173e1cd549a3b5f1c98983d91bfb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:35:23.520650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75764a-ef88-4fe0-b0d1-3c7234766d9f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.520933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75764a-ef88-4fe0-b0d1-3c7234766d9f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.521221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75764a-ef88-4fe0-b0d1-3c7234766d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:23.540302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:23.581130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9e75764a-ef88-4fe0-b0d1-3c7234766d9f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:23.582348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9e75764a-ef88-4fe0-b0d1-3c7234766d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:23.639773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1113/2202] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:23.647374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347bd3a-2f3e-4c7d-9e36-40af2ee691cc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.647660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347bd3a-2f3e-4c7d-9e36-40af2ee691cc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.647946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347bd3a-2f3e-4c7d-9e36-40af2ee691cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:23.666091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8347bd3a-2f3e-4c7d-9e36-40af2ee691cc None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:23.667954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8347bd3a-2f3e-4c7d-9e36-40af2ee691cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:23.676164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1090/2203] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:23.680191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75764a-ef88-4fe0-b0d1-3c7234766d9f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:23.689633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75764a-ef88-4fe0-b0d1-3c7234766d9f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:23.694101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceacd4-5297-4164-91c9-33ebd45b0dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:23.694791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceacd4-5297-4164-91c9-33ebd45b0dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.695074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceacd4-5297-4164-91c9-33ebd45b0dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.695348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceacd4-5297-4164-91c9-33ebd45b0dbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:23.696067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dceacd4-5297-4164-91c9-33ebd45b0dbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:35:23.696370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dceacd4-5297-4164-91c9-33ebd45b0dbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:23.698477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dceacd4-5297-4164-91c9-33ebd45b0dbc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:23.710092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1114/2204] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:35:23.714461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347bd3a-2f3e-4c7d-9e36-40af2ee691cc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:23.723394 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347bd3a-2f3e-4c7d-9e36-40af2ee691cc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:23.727975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9370897-8507-44cd-80a4-45feda20d906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:23.728605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370897-8507-44cd-80a4-45feda20d906 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.728887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370897-8507-44cd-80a4-45feda20d906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.729160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370897-8507-44cd-80a4-45feda20d906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:23.729841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9370897-8507-44cd-80a4-45feda20d906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:23.731778 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9370897-8507-44cd-80a4-45feda20d906 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:23.757258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1091/2205] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:35:23 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:35:23.761823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceacd4-5297-4164-91c9-33ebd45b0dbc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:23.771553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceacd4-5297-4164-91c9-33ebd45b0dbc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:23.826967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c09c15-eb52-47fe-9b14-0da3a7f4c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:23.827862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c09c15-eb52-47fe-9b14-0da3a7f4c064 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.827989 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c09c15-eb52-47fe-9b14-0da3a7f4c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.828211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c09c15-eb52-47fe-9b14-0da3a7f4c064 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:23.828906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c09c15-eb52-47fe-9b14-0da3a7f4c064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:23.830846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c09c15-eb52-47fe-9b14-0da3a7f4c064 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:23.851729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1115/2206] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:35:23 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:35:23.855835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9370897-8507-44cd-80a4-45feda20d906 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:23.866305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9370897-8507-44cd-80a4-45feda20d906 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:23.870926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe67e1f-c9c3-4283-942f-ad2224876cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:23.871574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe67e1f-c9c3-4283-942f-ad2224876cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.871860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe67e1f-c9c3-4283-942f-ad2224876cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.872138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe67e1f-c9c3-4283-942f-ad2224876cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:23.872879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe67e1f-c9c3-4283-942f-ad2224876cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:23.874485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe67e1f-c9c3-4283-942f-ad2224876cd6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:23.884206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1092/2207] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:35:23.888290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c09c15-eb52-47fe-9b14-0da3a7f4c064 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:23.898109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c09c15-eb52-47fe-9b14-0da3a7f4c064 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:23.903462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760171c-7a8c-4c97-b082-2fb1d24adbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:23.904115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760171c-7a8c-4c97-b082-2fb1d24adbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.904399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760171c-7a8c-4c97-b082-2fb1d24adbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.904677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760171c-7a8c-4c97-b082-2fb1d24adbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:23.905399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760171c-7a8c-4c97-b082-2fb1d24adbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:23.907048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760171c-7a8c-4c97-b082-2fb1d24adbd0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:23.917760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1116/2208] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:35:23.921923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe67e1f-c9c3-4283-942f-ad2224876cd6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:23.931920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe67e1f-c9c3-4283-942f-ad2224876cd6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:23.936689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fbadc-43d6-4e03-ac24-f552bf1d4917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:23.937585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fbadc-43d6-4e03-ac24-f552bf1d4917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.937868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fbadc-43d6-4e03-ac24-f552bf1d4917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.938144 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fbadc-43d6-4e03-ac24-f552bf1d4917 admin admin] PATH_INFO: `/v3/projects/1b633aa071864982b086ee60808e2aa2/users/51cb903140044e65b173f69146844990/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:23.952956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fbadc-43d6-4e03-ac24-f552bf1d4917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b633aa071864982b086ee60808e2aa2, user_id=51cb903140044e65b173f69146844990, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:23.955694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fbadc-43d6-4e03-ac24-f552bf1d4917 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:23.968755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1093/2209] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:35:23 2022] PUT /identity/v3/projects/1b633aa071864982b086ee60808e2aa2/users/51cb903140044e65b173f69146844990/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:35:23.979986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898257-a6a8-44e3-9057-932ebdfbfa84 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:23.980364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898257-a6a8-44e3-9057-932ebdfbfa84 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:23.980650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898257-a6a8-44e3-9057-932ebdfbfa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:24.007071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dc898257-a6a8-44e3-9057-932ebdfbfa84 None None] MFA Rules not processed for user `51cb903140044e65b173f69146844990`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:24.008270 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dc898257-a6a8-44e3-9057-932ebdfbfa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:24.047334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:24.071646 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1117/2210] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:24.082982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fbadc-43d6-4e03-ac24-f552bf1d4917 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:24.084651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-000fbadc-43d6-4e03-ac24-f552bf1d4917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:24.163427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fbadc-43d6-4e03-ac24-f552bf1d4917 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:24.167147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05844e3-ba99-4ae4-be84-de0a149e064b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:24.167781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05844e3-ba99-4ae4-be84-de0a149e064b service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:24.168088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05844e3-ba99-4ae4-be84-de0a149e064b service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:24.168365 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05844e3-ba99-4ae4-be84-de0a149e064b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:24.176719 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05844e3-ba99-4ae4-be84-de0a149e064b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:24.178139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05844e3-ba99-4ae4-be84-de0a149e064b service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:24.187289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1094/2211] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:35:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:35:24.211583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc898257-a6a8-44e3-9057-932ebdfbfa84 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:24.274197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc898257-a6a8-44e3-9057-932ebdfbfa84 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:24.278909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:24.279768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:24.280055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:24.280335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] PATH_INFO: `/v3/users/51cb903140044e65b173f69146844990` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:24.281536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cb903140044e65b173f69146844990)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:24.283499 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:24.328868 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cb903140044e65b173f69146844990'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:24.329445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cb903140044e65b173f69146844990'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:24.336310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cb903140044e65b173f69146844990'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:24.348086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cb903140044e65b173f69146844990'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:24.355199 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cb903140044e65b173f69146844990'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:24.360963 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1118/2212] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:35:24 2022] DELETE /identity/v3/users/51cb903140044e65b173f69146844990 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:35:24.365781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9babbc7-fb86-4613-8b75-211757742930 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:24.366070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9babbc7-fb86-4613-8b75-211757742930 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:24.366347 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9babbc7-fb86-4613-8b75-211757742930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:24.384109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f9babbc7-fb86-4613-8b75-211757742930 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:24.385300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f9babbc7-fb86-4613-8b75-211757742930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:24.449851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1095/2213] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:24.460338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:24.461753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:24.526988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:24.530726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceb82b-a3da-4fa2-b9cf-862796e9170d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:24.535244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e8a7a-67ff-4c9e-b069-bfe68e031d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:24.535934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8a7a-67ff-4c9e-b069-bfe68e031d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:24.536224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8a7a-67ff-4c9e-b069-bfe68e031d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:24.536664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8a7a-67ff-4c9e-b069-bfe68e031d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:24.546605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e8a7a-67ff-4c9e-b069-bfe68e031d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:24.548045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e8a7a-67ff-4c9e-b069-bfe68e031d64 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:24.558311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1119/2214] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:35:24.820045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9babbc7-fb86-4613-8b75-211757742930 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:24.821456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f9babbc7-fb86-4613-8b75-211757742930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:24.833311 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9babbc7-fb86-4613-8b75-211757742930 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:24.837884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:24.839316 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:24.839618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:24.839991 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] PATH_INFO: `/v3/projects/1b633aa071864982b086ee60808e2aa2` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:24.841171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b633aa071864982b086ee60808e2aa2)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:24.843103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:24.844796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:24.892499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b633aa071864982b086ee60808e2aa2', 'request_id': 'req-183f3eb5-fd37-4a07-805c-74374ac9a09f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:24.898190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b633aa071864982b086ee60808e2aa2', 'request_id': 'req-183f3eb5-fd37-4a07-805c-74374ac9a09f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:24.904921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b633aa071864982b086ee60808e2aa2', 'request_id': 'req-183f3eb5-fd37-4a07-805c-74374ac9a09f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:24.917661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] The token cache is being invalidate because project 1b633aa071864982b086ee60808e2aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:35:24.917952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:24.918605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-183f3eb5-fd37-4a07-805c-74374ac9a09f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:35:24.920161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1096/2215] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:35:24 2022] DELETE /identity/v3/projects/1b633aa071864982b086ee60808e2aa2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:35:24.924957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fce37-b23a-440e-a832-f9441591d73a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:24.925250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fce37-b23a-440e-a832-f9441591d73a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:24.925535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fce37-b23a-440e-a832-f9441591d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:24.944273 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d52fce37-b23a-440e-a832-f9441591d73a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:24.945482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d52fce37-b23a-440e-a832-f9441591d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:25.004287 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1120/2216] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:25.011886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92235a0-185e-43b2-856d-08453308cc6f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:25.012178 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92235a0-185e-43b2-856d-08453308cc6f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:25.012484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92235a0-185e-43b2-856d-08453308cc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:25.030810 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e92235a0-185e-43b2-856d-08453308cc6f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:25.032018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e92235a0-185e-43b2-856d-08453308cc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:25.040208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1097/2217] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:25.044656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fce37-b23a-440e-a832-f9441591d73a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:25.054569 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fce37-b23a-440e-a832-f9441591d73a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:25.059140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d01e45-0c52-4183-abc5-d19535e47d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:25.059788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d01e45-0c52-4183-abc5-d19535e47d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:25.060072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d01e45-0c52-4183-abc5-d19535e47d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:25.060349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d01e45-0c52-4183-abc5-d19535e47d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:25.061074 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d01e45-0c52-4183-abc5-d19535e47d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:35:25.061409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d01e45-0c52-4183-abc5-d19535e47d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:25.063047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d01e45-0c52-4183-abc5-d19535e47d3b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:25.074371 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1121/2218] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:35:25.078299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92235a0-185e-43b2-856d-08453308cc6f None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:25.087307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92235a0-185e-43b2-856d-08453308cc6f None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:25.092395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925fafd-9df0-45b4-a669-a26d0ae192e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:25.093028 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925fafd-9df0-45b4-a669-a26d0ae192e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:25.093313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925fafd-9df0-45b4-a669-a26d0ae192e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:25.093590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925fafd-9df0-45b4-a669-a26d0ae192e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:25.094279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925fafd-9df0-45b4-a669-a26d0ae192e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:25.096186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925fafd-9df0-45b4-a669-a26d0ae192e3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:25.124724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1098/2219] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:35:25 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:35:25.125819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d01e45-0c52-4183-abc5-d19535e47d3b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:25.135620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d01e45-0c52-4183-abc5-d19535e47d3b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:25.193192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc417d0c-98db-4463-b4a4-d5bd56544270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:25.193780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc417d0c-98db-4463-b4a4-d5bd56544270 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:25.194060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc417d0c-98db-4463-b4a4-d5bd56544270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:25.194333 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc417d0c-98db-4463-b4a4-d5bd56544270 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:25.195065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc417d0c-98db-4463-b4a4-d5bd56544270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:25.196958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc417d0c-98db-4463-b4a4-d5bd56544270 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:25.217525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1122/2220] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:35:25 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:35:25.221766 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925fafd-9df0-45b4-a669-a26d0ae192e3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:25.231985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925fafd-9df0-45b4-a669-a26d0ae192e3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:25.236634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7858ba-1809-44e3-83cd-be1604966b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:25.237281 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7858ba-1809-44e3-83cd-be1604966b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:25.237567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7858ba-1809-44e3-83cd-be1604966b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:25.237849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7858ba-1809-44e3-83cd-be1604966b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:25.238885 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7858ba-1809-44e3-83cd-be1604966b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:25.240475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7858ba-1809-44e3-83cd-be1604966b4c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:25.250832 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1099/2221] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:35:25.254601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc417d0c-98db-4463-b4a4-d5bd56544270 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:25.266098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc417d0c-98db-4463-b4a4-d5bd56544270 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:25.271059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0858d42-b998-43c4-b9e3-5f7f7fc3457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:25.271727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0858d42-b998-43c4-b9e3-5f7f7fc3457d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:25.272015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0858d42-b998-43c4-b9e3-5f7f7fc3457d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:25.272295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0858d42-b998-43c4-b9e3-5f7f7fc3457d admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:25.273110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0858d42-b998-43c4-b9e3-5f7f7fc3457d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:25.275286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0858d42-b998-43c4-b9e3-5f7f7fc3457d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:25.288420 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1123/2222] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:35:25.292572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7858ba-1809-44e3-83cd-be1604966b4c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:25.302526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7858ba-1809-44e3-83cd-be1604966b4c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:25.307209 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed635bf-e380-42bf-a136-11d8640785bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:25.308078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed635bf-e380-42bf-a136-11d8640785bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:25.308365 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed635bf-e380-42bf-a136-11d8640785bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:25.308647 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed635bf-e380-42bf-a136-11d8640785bb admin admin] PATH_INFO: `/v3/projects/36c078f96f1641c08b86ec764b349f6a/users/cb7770b5381b44d2a018dec3a8b59143/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:25.323375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed635bf-e380-42bf-a136-11d8640785bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c078f96f1641c08b86ec764b349f6a, user_id=cb7770b5381b44d2a018dec3a8b59143, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:25.326025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed635bf-e380-42bf-a136-11d8640785bb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:25.339636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1100/2223] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:35:25 2022] PUT /identity/v3/projects/36c078f96f1641c08b86ec764b349f6a/users/cb7770b5381b44d2a018dec3a8b59143/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:35:25.344517 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ac8c4-ce8e-4914-bc66-a8eae71674d4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:25.344834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ac8c4-ce8e-4914-bc66-a8eae71674d4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:25.345118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ac8c4-ce8e-4914-bc66-a8eae71674d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:25.362653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-707ac8c4-ce8e-4914-bc66-a8eae71674d4 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:25.364134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-707ac8c4-ce8e-4914-bc66-a8eae71674d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:25.414205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:25.424718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1124/2224] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:25.434300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed635bf-e380-42bf-a136-11d8640785bb admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:25.436015 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7ed635bf-e380-42bf-a136-11d8640785bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:25.492284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed635bf-e380-42bf-a136-11d8640785bb admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:25.495903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50030e41-c487-4ce6-a39b-0ad4dfeb8fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:25.496541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50030e41-c487-4ce6-a39b-0ad4dfeb8fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:25.496827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50030e41-c487-4ce6-a39b-0ad4dfeb8fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:25.497105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50030e41-c487-4ce6-a39b-0ad4dfeb8fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:25.506090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50030e41-c487-4ce6-a39b-0ad4dfeb8fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:25.507544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50030e41-c487-4ce6-a39b-0ad4dfeb8fa7 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:25.517413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1101/2225] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:35:26.132534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ea86-7b1b-43f6-981b-a4ad3b994c18 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:26.133068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ea86-7b1b-43f6-981b-a4ad3b994c18 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:26.133068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ea86-7b1b-43f6-981b-a4ad3b994c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:26.159934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d600ea86-7b1b-43f6-981b-a4ad3b994c18 None None] MFA Rules not processed for user `cb7770b5381b44d2a018dec3a8b59143`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:26.161241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d600ea86-7b1b-43f6-981b-a4ad3b994c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:26.232118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1125/2226] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:35:26.243278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50030e41-c487-4ce6-a39b-0ad4dfeb8fa7 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:35:26.245385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-50030e41-c487-4ce6-a39b-0ad4dfeb8fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:26.279150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:26.306874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50030e41-c487-4ce6-a39b-0ad4dfeb8fa7 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:35:26.310945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b0fff-cd37-4b03-9770-11cafdd560e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:35:26.311591 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b0fff-cd37-4b03-9770-11cafdd560e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:26.311932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b0fff-cd37-4b03-9770-11cafdd560e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:26.312217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b0fff-cd37-4b03-9770-11cafdd560e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:26.320813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b0fff-cd37-4b03-9770-11cafdd560e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:35:26.322241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b0fff-cd37-4b03-9770-11cafdd560e8 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:35:26.331651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1102/2227] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:35:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:35:27.669991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355328c-5638-44e3-87f6-e84bb76c0217 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:27.670547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355328c-5638-44e3-87f6-e84bb76c0217 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:27.670641 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355328c-5638-44e3-87f6-e84bb76c0217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:27.688436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-8355328c-5638-44e3-87f6-e84bb76c0217 None None] MFA Rules not processed for user `cb7770b5381b44d2a018dec3a8b59143`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:27.689634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8355328c-5638-44e3-87f6-e84bb76c0217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:27.696549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1126/2228] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:35:36.327607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=13 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:37.682534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=36 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:35:53.584132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882e2c1-f046-4305-901a-e3f2e6072cd5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:35:53.584637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882e2c1-f046-4305-901a-e3f2e6072cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:35:53.584736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882e2c1-f046-4305-901a-e3f2e6072cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:35:53.601343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-9882e2c1-f046-4305-901a-e3f2e6072cd5 None None] MFA Rules not processed for user `6ca2454700fa46dbbfe0fe44bcbc266c`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:35:53.602569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9882e2c1-f046-4305-901a-e3f2e6072cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:35:53.659105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1103/2229] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:03.652408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=25 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:10.204223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca9bc-71f0-4ca8-b1da-ddda47baed74 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:10.204784 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca9bc-71f0-4ca8-b1da-ddda47baed74 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:10.204784 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca9bc-71f0-4ca8-b1da-ddda47baed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:10.222945 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0d9ca9bc-71f0-4ca8-b1da-ddda47baed74 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:10.224139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0d9ca9bc-71f0-4ca8-b1da-ddda47baed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:10.231957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1127/2230] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:10.250490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882e2c1-f046-4305-901a-e3f2e6072cd5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:10.251869 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9882e2c1-f046-4305-901a-e3f2e6072cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:10.344496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882e2c1-f046-4305-901a-e3f2e6072cd5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:10.349982 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a2c7-4785-41da-9081-2d08bf06b77b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:10.350658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a2c7-4785-41da-9081-2d08bf06b77b service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:10.350946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a2c7-4785-41da-9081-2d08bf06b77b service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:10.351226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a2c7-4785-41da-9081-2d08bf06b77b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:10.359385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8a2c7-4785-41da-9081-2d08bf06b77b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:10.360954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8a2c7-4785-41da-9081-2d08bf06b77b service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:10.370599 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1104/2231] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:36:16.289987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf355-e3fc-4b7d-a102-77d65cddab2d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:16.290415 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf355-e3fc-4b7d-a102-77d65cddab2d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:16.290564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf355-e3fc-4b7d-a102-77d65cddab2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:16.308976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-edcbf355-e3fc-4b7d-a102-77d65cddab2d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:16.310161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-edcbf355-e3fc-4b7d-a102-77d65cddab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:16.318625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1128/2232] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:16.333155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a2c7-4785-41da-9081-2d08bf06b77b service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:16.334565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dde8a2c7-4785-41da-9081-2d08bf06b77b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:16.349195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a2c7-4785-41da-9081-2d08bf06b77b service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:16.354660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91234372-961b-4dbb-8177-d5a9ec37d26d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:16.355288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91234372-961b-4dbb-8177-d5a9ec37d26d service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:16.355574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91234372-961b-4dbb-8177-d5a9ec37d26d service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:16.355854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91234372-961b-4dbb-8177-d5a9ec37d26d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:16.364689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91234372-961b-4dbb-8177-d5a9ec37d26d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:16.366248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91234372-961b-4dbb-8177-d5a9ec37d26d service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:16.376271 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1105/2233] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:36:18.583788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceda984-a098-4d5e-adaa-2a25b60aaabf None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:18.584510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceda984-a098-4d5e-adaa-2a25b60aaabf None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:18.584510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceda984-a098-4d5e-adaa-2a25b60aaabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:18.632709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3ceda984-a098-4d5e-adaa-2a25b60aaabf None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:18.633906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3ceda984-a098-4d5e-adaa-2a25b60aaabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:18.695848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1129/2234] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:18.718798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91234372-961b-4dbb-8177-d5a9ec37d26d service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:18.720945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-91234372-961b-4dbb-8177-d5a9ec37d26d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:18.817219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91234372-961b-4dbb-8177-d5a9ec37d26d service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:18.822224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbf82c-b4a8-42ea-b7db-660bcd19a22e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:18.822896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf82c-b4a8-42ea-b7db-660bcd19a22e service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:18.823179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf82c-b4a8-42ea-b7db-660bcd19a22e service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:18.823453 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf82c-b4a8-42ea-b7db-660bcd19a22e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:18.832357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbf82c-b4a8-42ea-b7db-660bcd19a22e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:18.834073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbf82c-b4a8-42ea-b7db-660bcd19a22e service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:18.842376 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1106/2235] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:36:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:36:21.731503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38823a-a14b-4a89-867b-849ebd436490 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:21.732123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38823a-a14b-4a89-867b-849ebd436490 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:21.732123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38823a-a14b-4a89-867b-849ebd436490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:21.752227 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6a38823a-a14b-4a89-867b-849ebd436490 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:21.753715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6a38823a-a14b-4a89-867b-849ebd436490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:21.764207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1130/2236] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:21.786704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbf82c-b4a8-42ea-b7db-660bcd19a22e service swift] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:21.800001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbf82c-b4a8-42ea-b7db-660bcd19a22e service swift] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:21.808037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42377ab-d2f9-49cc-b83c-39652a4643c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:21.808922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42377ab-d2f9-49cc-b83c-39652a4643c6 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:21.809206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42377ab-d2f9-49cc-b83c-39652a4643c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:21.809477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42377ab-d2f9-49cc-b83c-39652a4643c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:21.819430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42377ab-d2f9-49cc-b83c-39652a4643c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:21.821341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42377ab-d2f9-49cc-b83c-39652a4643c6 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:21.837706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1107/2237] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:36:26.852598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b720c-f46e-4938-9a1e-8760e20e5baf None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:26.853160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b720c-f46e-4938-9a1e-8760e20e5baf None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:26.853160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b720c-f46e-4938-9a1e-8760e20e5baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:26.875132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9e4b720c-f46e-4938-9a1e-8760e20e5baf None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:26.876410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9e4b720c-f46e-4938-9a1e-8760e20e5baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:26.888659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1131/2238] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:26.902274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42377ab-d2f9-49cc-b83c-39652a4643c6 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:26.914134 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42377ab-d2f9-49cc-b83c-39652a4643c6 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:26.919755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be755c39-c36b-4006-8f69-f88114aaaa2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:26.920928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be755c39-c36b-4006-8f69-f88114aaaa2a service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:26.921213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be755c39-c36b-4006-8f69-f88114aaaa2a service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:26.921488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be755c39-c36b-4006-8f69-f88114aaaa2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:26.929318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:26.931732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be755c39-c36b-4006-8f69-f88114aaaa2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:26.933922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be755c39-c36b-4006-8f69-f88114aaaa2a service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:26.950224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1108/2239] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:36:33.078801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d0149-024a-4a84-a26a-962fd9062ac3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:33.079277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d0149-024a-4a84-a26a-962fd9062ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:33.079400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d0149-024a-4a84-a26a-962fd9062ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:33.097787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-510d0149-024a-4a84-a26a-962fd9062ac3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:33.098955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-510d0149-024a-4a84-a26a-962fd9062ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:33.106683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1132/2240] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:33.126763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be755c39-c36b-4006-8f69-f88114aaaa2a service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:33.137772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be755c39-c36b-4006-8f69-f88114aaaa2a service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:33.143825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915fb24-43bb-4337-991f-dc0ba7699b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:33.144452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915fb24-43bb-4337-991f-dc0ba7699b1f service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:33.144734 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915fb24-43bb-4337-991f-dc0ba7699b1f service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:33.145011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915fb24-43bb-4337-991f-dc0ba7699b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:33.153201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915fb24-43bb-4337-991f-dc0ba7699b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:33.154798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915fb24-43bb-4337-991f-dc0ba7699b1f service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:33.164562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1109/2241] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:36:35.275121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bb378-b286-4732-b79a-2369a82896b3 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:35.275648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bb378-b286-4732-b79a-2369a82896b3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:35.275768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bb378-b286-4732-b79a-2369a82896b3 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:35.277046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1133/2242] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:36:35.283250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134dc8-8652-495a-85b3-6290f8ae5d7f None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:35.283704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134dc8-8652-495a-85b3-6290f8ae5d7f None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:35.283808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134dc8-8652-495a-85b3-6290f8ae5d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:35.320306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e9134dc8-8652-495a-85b3-6290f8ae5d7f None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:35.321579 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e9134dc8-8652-495a-85b3-6290f8ae5d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:35.331133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1110/2243] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:35.350681 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9bb378-b286-4732-b79a-2369a82896b3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:35.352368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ca9bb378-b286-4732-b79a-2369a82896b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:35.432717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9bb378-b286-4732-b79a-2369a82896b3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:35.436195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64769e29-dcd7-49b3-969d-a6d1a772a11e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe27c3402a741f0a80d87ae6ecd3f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:35.436833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64769e29-dcd7-49b3-969d-a6d1a772a11e service glance] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:35.437118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64769e29-dcd7-49b3-969d-a6d1a772a11e service glance] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:35.437396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64769e29-dcd7-49b3-969d-a6d1a772a11e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:35.447249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64769e29-dcd7-49b3-969d-a6d1a772a11e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:35.448778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64769e29-dcd7-49b3-969d-a6d1a772a11e service glance] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:35.459319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1134/2244] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:36:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:36:35.525340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a976-a3e1-436c-ab3e-51104254647e None None] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:35.525633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a976-a3e1-436c-ab3e-51104254647e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:35.525908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a976-a3e1-436c-ab3e-51104254647e None None] PATH_INFO: `/` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:35.527330 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1111/2245] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:36:35.532576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691512e3-967a-43f5-b03e-9e28a0a26667 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:35.532870 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691512e3-967a-43f5-b03e-9e28a0a26667 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:35.533155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691512e3-967a-43f5-b03e-9e28a0a26667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:35.551722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-691512e3-967a-43f5-b03e-9e28a0a26667 None None] MFA Rules not processed for user `4160318c1b9b49539c6a2d8110289463`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:35.552926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-691512e3-967a-43f5-b03e-9e28a0a26667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:35.559364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1135/2246] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:35.571294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12a976-a3e1-436c-ab3e-51104254647e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:35.573118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ee12a976-a3e1-436c-ab3e-51104254647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:35.586868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12a976-a3e1-436c-ab3e-51104254647e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:35.590382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be458f5-c78d-4248-88d0-02c5312c480f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:35.591045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be458f5-c78d-4248-88d0-02c5312c480f service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:35.591331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be458f5-c78d-4248-88d0-02c5312c480f service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:35.591609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be458f5-c78d-4248-88d0-02c5312c480f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:35.599583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be458f5-c78d-4248-88d0-02c5312c480f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:35.601055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be458f5-c78d-4248-88d0-02c5312c480f service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:35.608871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1112/2247] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:36:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:36:35.689814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586329a-a260-418e-9eaa-96b4bc5acc18 None None] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:35.689972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586329a-a260-418e-9eaa-96b4bc5acc18 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:35.690172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586329a-a260-418e-9eaa-96b4bc5acc18 None None] PATH_INFO: `/` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:35.691644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1136/2248] 10.222.0.44 () {54 vars in 921 bytes} [Fri Jun 24 10:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 10:36:35.697464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20934720-4c8a-4f33-b114-02bf4e7af2f3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:35.697938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20934720-4c8a-4f33-b114-02bf4e7af2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:35.698409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20934720-4c8a-4f33-b114-02bf4e7af2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:35.724878 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-20934720-4c8a-4f33-b114-02bf4e7af2f3 None None] MFA Rules not processed for user `a66ff3915a784ddcb3925aadcb416700`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:35.726111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-20934720-4c8a-4f33-b114-02bf4e7af2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:35.735926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1113/2249] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Jun 24 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:35.747045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586329a-a260-418e-9eaa-96b4bc5acc18 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:35.758185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586329a-a260-418e-9eaa-96b4bc5acc18 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:35.761736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6860-8c4d-4233-8443-b1ba424394ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:35.762536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6860-8c4d-4233-8443-b1ba424394ee service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:35.762821 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6860-8c4d-4233-8443-b1ba424394ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:35.763097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd6860-8c4d-4233-8443-b1ba424394ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:35.773570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd6860-8c4d-4233-8443-b1ba424394ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:35.775020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd6860-8c4d-4233-8443-b1ba424394ee service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:35.786338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1137/2250] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:36:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:36:38.153707 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4427fdb-5c02-4275-818e-90103d24faac None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:38.154180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4427fdb-5c02-4275-818e-90103d24faac None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:38.154292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4427fdb-5c02-4275-818e-90103d24faac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:38.172066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c4427fdb-5c02-4275-818e-90103d24faac None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:38.173479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c4427fdb-5c02-4275-818e-90103d24faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:38.180511 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1114/2251] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:36:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:38.193605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6860-8c4d-4233-8443-b1ba424394ee service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:38.199134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:38.205407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd6860-8c4d-4233-8443-b1ba424394ee service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:38.210394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc81dc3-e14e-43ce-99f3-4a91fec09c60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:38.211075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81dc3-e14e-43ce-99f3-4a91fec09c60 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:38.211358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81dc3-e14e-43ce-99f3-4a91fec09c60 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:38.211632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81dc3-e14e-43ce-99f3-4a91fec09c60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:38.220488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc81dc3-e14e-43ce-99f3-4a91fec09c60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:38.222116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc81dc3-e14e-43ce-99f3-4a91fec09c60 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:38.230510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1138/2252] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:36:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:36:38.322993 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6eaa4-8c30-4856-abc7-14dd7773972a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:38.323416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6eaa4-8c30-4856-abc7-14dd7773972a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:38.323553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6eaa4-8c30-4856-abc7-14dd7773972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:38.360679 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-40c6eaa4-8c30-4856-abc7-14dd7773972a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:36:38.364997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-40c6eaa4-8c30-4856-abc7-14dd7773972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:36:38.376978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1115/2253] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:36:38.394276 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc81dc3-e14e-43ce-99f3-4a91fec09c60 service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:36:38.415828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc81dc3-e14e-43ce-99f3-4a91fec09c60 service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:36:38.424755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d5c9-b1af-4cb3-9188-2e5345cb7218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:36:38.425628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d5c9-b1af-4cb3-9188-2e5345cb7218 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:36:38.426077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d5c9-b1af-4cb3-9188-2e5345cb7218 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:36:38.426559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d5c9-b1af-4cb3-9188-2e5345cb7218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:36:38.438301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465d5c9-b1af-4cb3-9188-2e5345cb7218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:36:38.440162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465d5c9-b1af-4cb3-9188-2e5345cb7218 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:36:38.451311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1139/2254] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:36:48.349359 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=32 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:36:48.446808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=11 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:12.844996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902269-d110-4956-94aa-ad7c1c6767dc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:12.845485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902269-d110-4956-94aa-ad7c1c6767dc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:12.845583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902269-d110-4956-94aa-ad7c1c6767dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:12.863877 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-17902269-d110-4956-94aa-ad7c1c6767dc None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:37:12.865332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-17902269-d110-4956-94aa-ad7c1c6767dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:12.872477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1116/2255] 10.222.0.44 () {58 vars in 967 bytes} [Fri Jun 24 10:37:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:37:12.884240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d5c9-b1af-4cb3-9188-2e5345cb7218 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:37:12.895197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d5c9-b1af-4cb3-9188-2e5345cb7218 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:37:12.900073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c4839-0ca0-4532-a653-46bf82bef017 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:37:12.900733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c4839-0ca0-4532-a653-46bf82bef017 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:12.901017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c4839-0ca0-4532-a653-46bf82bef017 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:12.901302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c4839-0ca0-4532-a653-46bf82bef017 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:12.909207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c4839-0ca0-4532-a653-46bf82bef017 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:37:12.912061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c4839-0ca0-4532-a653-46bf82bef017 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:37:12.920810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1140/2256] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:37:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:37:19.125095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17902269-d110-4956-94aa-ad7c1c6767dc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:37:19.134569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17902269-d110-4956-94aa-ad7c1c6767dc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:37:19.138090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889e9fe-a4a5-40ce-a6a6-f779bfd205dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:37:19.138761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889e9fe-a4a5-40ce-a6a6-f779bfd205dc service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:19.139045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889e9fe-a4a5-40ce-a6a6-f779bfd205dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:19.139341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889e9fe-a4a5-40ce-a6a6-f779bfd205dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:19.141080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0889e9fe-a4a5-40ce-a6a6-f779bfd205dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:19.154649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889e9fe-a4a5-40ce-a6a6-f779bfd205dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:37:19.156060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889e9fe-a4a5-40ce-a6a6-f779bfd205dc service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:37:19.167452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1117/2257] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:37:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:37:19.290782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5b1a0-268c-43d6-b7e2-3096c1017b95 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:19.291257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5b1a0-268c-43d6-b7e2-3096c1017b95 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:19.291372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5b1a0-268c-43d6-b7e2-3096c1017b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:19.308774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-95e5b1a0-268c-43d6-b7e2-3096c1017b95 None None] MFA Rules not processed for user `cb7770b5381b44d2a018dec3a8b59143`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:37:19.309990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-95e5b1a0-268c-43d6-b7e2-3096c1017b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:19.317509 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1141/2258] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:37:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:37:19.352018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889e9fe-a4a5-40ce-a6a6-f779bfd205dc service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:37:19.353416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-0889e9fe-a4a5-40ce-a6a6-f779bfd205dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:19.365030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889e9fe-a4a5-40ce-a6a6-f779bfd205dc service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:37:19.368569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2d458-851c-4618-a5ed-5b52328a43c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe27c3402a741f0a80d87ae6ecd3f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:37:19.369203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2d458-851c-4618-a5ed-5b52328a43c8 service glance] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:19.369490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2d458-851c-4618-a5ed-5b52328a43c8 service glance] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:19.369772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2d458-851c-4618-a5ed-5b52328a43c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:19.371521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1db2d458-851c-4618-a5ed-5b52328a43c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:19.386877 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2d458-851c-4618-a5ed-5b52328a43c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:37:19.388382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2d458-851c-4618-a5ed-5b52328a43c8 service glance] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:37:19.401160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1118/2259] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:37:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:37:29.303403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=9 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:29.395927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=15 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:37:35.456518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742e113-3f84-41a5-8f75-1b674990d6eb None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:35.457564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742e113-3f84-41a5-8f75-1b674990d6eb None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:35.457564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742e113-3f84-41a5-8f75-1b674990d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:35.475845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-9742e113-3f84-41a5-8f75-1b674990d6eb None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:37:35.477056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9742e113-3f84-41a5-8f75-1b674990d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:35.484904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1142/2260] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:37:35.502114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2d458-851c-4618-a5ed-5b52328a43c8 service glance] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:37:35.513327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2d458-851c-4618-a5ed-5b52328a43c8 service glance] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:37:35.518859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdf97b-6e3a-4791-970d-850045c533a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:37:35.519541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdf97b-6e3a-4791-970d-850045c533a0 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:35.520326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdf97b-6e3a-4791-970d-850045c533a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:35.520605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdf97b-6e3a-4791-970d-850045c533a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:35.528574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdf97b-6e3a-4791-970d-850045c533a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:37:35.530138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdf97b-6e3a-4791-970d-850045c533a0 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:37:35.540420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1119/2261] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:37:39.740817 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bf5d3-e769-4d57-bc8c-20138c0a88af None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:39.741328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bf5d3-e769-4d57-bc8c-20138c0a88af None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:39.741328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bf5d3-e769-4d57-bc8c-20138c0a88af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:39.758972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c98bf5d3-e769-4d57-bc8c-20138c0a88af None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:37:39.760171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c98bf5d3-e769-4d57-bc8c-20138c0a88af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:39.768219 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1143/2262] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:37:39.783709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdf97b-6e3a-4791-970d-850045c533a0 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:37:39.795673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdf97b-6e3a-4791-970d-850045c533a0 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:37:39.805492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23435fc-021a-40cc-99ae-3bb4774a6c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:37:39.806459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23435fc-021a-40cc-99ae-3bb4774a6c52 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:39.806935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23435fc-021a-40cc-99ae-3bb4774a6c52 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:39.807208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23435fc-021a-40cc-99ae-3bb4774a6c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:39.816727 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23435fc-021a-40cc-99ae-3bb4774a6c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:37:39.818384 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23435fc-021a-40cc-99ae-3bb4774a6c52 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:37:39.828290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1120/2263] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:37:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:37:43.908310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bf5d3-e769-4d57-bc8c-20138c0a88af None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:37:43.917936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bf5d3-e769-4d57-bc8c-20138c0a88af None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:37:43.921831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f548-f87a-4af5-9cf4-07749c3b26d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe27c3402a741f0a80d87ae6ecd3f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:37:43.922520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f548-f87a-4af5-9cf4-07749c3b26d2 service glance] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:43.922832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f548-f87a-4af5-9cf4-07749c3b26d2 service glance] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:43.923108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f548-f87a-4af5-9cf4-07749c3b26d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:43.924928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7826f548-f87a-4af5-9cf4-07749c3b26d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:43.985833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826f548-f87a-4af5-9cf4-07749c3b26d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:37:43.987307 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826f548-f87a-4af5-9cf4-07749c3b26d2 service glance] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:37:43.996943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1144/2264] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:37:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:37:44.857590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddd76e-a106-4556-8301-b72e5d01a5a4 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:44.858089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddd76e-a106-4556-8301-b72e5d01a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:44.858188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddd76e-a106-4556-8301-b72e5d01a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:44.875983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-19ddd76e-a106-4556-8301-b72e5d01a5a4 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:37:44.877160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-19ddd76e-a106-4556-8301-b72e5d01a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:44.885637 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1121/2265] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:37:44.901313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f548-f87a-4af5-9cf4-07749c3b26d2 service glance] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:37:44.913543 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f548-f87a-4af5-9cf4-07749c3b26d2 service glance] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:37:44.919123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb828e-aea7-4f50-a904-25e530130b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:37:44.919787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb828e-aea7-4f50-a904-25e530130b65 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:44.920075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb828e-aea7-4f50-a904-25e530130b65 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:44.920354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb828e-aea7-4f50-a904-25e530130b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:44.928555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb828e-aea7-4f50-a904-25e530130b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:37:44.930137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb828e-aea7-4f50-a904-25e530130b65 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:37:44.939632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1145/2266] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:37:50.055621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8fdc3-eee6-43a9-a7c4-9ffaa11edd8e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:50.056099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8fdc3-eee6-43a9-a7c4-9ffaa11edd8e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:50.056212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8fdc3-eee6-43a9-a7c4-9ffaa11edd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:50.074276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-06a8fdc3-eee6-43a9-a7c4-9ffaa11edd8e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:37:50.075489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-06a8fdc3-eee6-43a9-a7c4-9ffaa11edd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:50.083750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1122/2267] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:37:50.099865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb828e-aea7-4f50-a904-25e530130b65 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:37:50.110699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb828e-aea7-4f50-a904-25e530130b65 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:37:50.120114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f1b8b-e1cf-4efb-9fc3-bd36c33f73dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:37:50.120756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f1b8b-e1cf-4efb-9fc3-bd36c33f73dd service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:50.121042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f1b8b-e1cf-4efb-9fc3-bd36c33f73dd service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:50.121317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f1b8b-e1cf-4efb-9fc3-bd36c33f73dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:50.130430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f1b8b-e1cf-4efb-9fc3-bd36c33f73dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:37:50.132014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f1b8b-e1cf-4efb-9fc3-bd36c33f73dd service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:37:50.141361 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1146/2268] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:37:55.288789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100340f-f5db-406b-a48d-cc81dfa8f477 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:55.289211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100340f-f5db-406b-a48d-cc81dfa8f477 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:55.289366 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100340f-f5db-406b-a48d-cc81dfa8f477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:55.307140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d100340f-f5db-406b-a48d-cc81dfa8f477 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:37:55.308338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d100340f-f5db-406b-a48d-cc81dfa8f477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:55.316241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1123/2269] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 10:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:37:55.331409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f1b8b-e1cf-4efb-9fc3-bd36c33f73dd service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:37:55.343298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f1b8b-e1cf-4efb-9fc3-bd36c33f73dd service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:37:55.348750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b97c1f-1925-4684-a68c-f70251d72e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:37:55.349411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97c1f-1925-4684-a68c-f70251d72e45 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:55.349697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97c1f-1925-4684-a68c-f70251d72e45 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:55.349974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97c1f-1925-4684-a68c-f70251d72e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:55.358177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b97c1f-1925-4684-a68c-f70251d72e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:37:55.359804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b97c1f-1925-4684-a68c-f70251d72e45 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:37:55.369994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1147/2270] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:37:56.928498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100340f-f5db-406b-a48d-cc81dfa8f477 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:37:56.941080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100340f-f5db-406b-a48d-cc81dfa8f477 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:37:56.947651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa7745-4c9e-4e51-83d9-a70ab5317fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:37:56.948289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7745-4c9e-4e51-83d9-a70ab5317fa8 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:37:56.948575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7745-4c9e-4e51-83d9-a70ab5317fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:37:56.948853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7745-4c9e-4e51-83d9-a70ab5317fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:37:56.950657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4eaa7745-4c9e-4e51-83d9-a70ab5317fa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:37:57.009806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa7745-4c9e-4e51-83d9-a70ab5317fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:37:57.011419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa7745-4c9e-4e51-83d9-a70ab5317fa8 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:37:57.021091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1124/2271] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:37:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:03.074636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b97c1f-1925-4684-a68c-f70251d72e45 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:03.079216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=53 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:03.085675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b97c1f-1925-4684-a68c-f70251d72e45 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:03.089745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d8dfc-e969-4d69-8dcb-476000e5ae92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:03.090454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d8dfc-e969-4d69-8dcb-476000e5ae92 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:03.090741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d8dfc-e969-4d69-8dcb-476000e5ae92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:03.091019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d8dfc-e969-4d69-8dcb-476000e5ae92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:03.092845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d31d8dfc-e969-4d69-8dcb-476000e5ae92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:03.105149 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d8dfc-e969-4d69-8dcb-476000e5ae92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:03.107923 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d8dfc-e969-4d69-8dcb-476000e5ae92 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:03.119828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1148/2272] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:07.016184 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=49 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:09.338643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43604e7d-52ce-4ccc-9c0a-cfe835483168 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:09.339240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43604e7d-52ce-4ccc-9c0a-cfe835483168 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:09.339240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43604e7d-52ce-4ccc-9c0a-cfe835483168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:09.356225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-43604e7d-52ce-4ccc-9c0a-cfe835483168 None None] MFA Rules not processed for user `6e971595d77647dca5a29a5574c6627d`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:38:09.357411 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-43604e7d-52ce-4ccc-9c0a-cfe835483168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:09.365297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1125/2273] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:38:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:38:10.269462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d8dfc-e969-4d69-8dcb-476000e5ae92 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:10.285162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d8dfc-e969-4d69-8dcb-476000e5ae92 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:10.291340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e2bd-c9e5-4b97-b0db-f8eb432dbb58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:10.291995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e2bd-c9e5-4b97-b0db-f8eb432dbb58 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:10.292302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e2bd-c9e5-4b97-b0db-f8eb432dbb58 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:10.292588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e2bd-c9e5-4b97-b0db-f8eb432dbb58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:10.294423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2fc2e2bd-c9e5-4b97-b0db-f8eb432dbb58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:10.307582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2e2bd-c9e5-4b97-b0db-f8eb432dbb58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:10.309184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2e2bd-c9e5-4b97-b0db-f8eb432dbb58 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:10.321731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1149/2274] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:16.889971 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43604e7d-52ce-4ccc-9c0a-cfe835483168 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:16.906108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43604e7d-52ce-4ccc-9c0a-cfe835483168 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:16.915277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653c375-13e7-44b7-9022-77fe8460903f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:16.916022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653c375-13e7-44b7-9022-77fe8460903f service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:16.916395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653c375-13e7-44b7-9022-77fe8460903f service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:16.916739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653c375-13e7-44b7-9022-77fe8460903f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:16.919098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3653c375-13e7-44b7-9022-77fe8460903f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:16.934834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653c375-13e7-44b7-9022-77fe8460903f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:16.936609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653c375-13e7-44b7-9022-77fe8460903f service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:16.955345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1126/2275] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:20.315408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=11 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:26.949392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=9 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:28.005668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e2bd-c9e5-4b97-b0db-f8eb432dbb58 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:28.017401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e2bd-c9e5-4b97-b0db-f8eb432dbb58 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:28.023309 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144303b-dcc0-4b98-9de3-9a6c1844b9b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:28.023971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144303b-dcc0-4b98-9de3-9a6c1844b9b5 service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:28.024257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144303b-dcc0-4b98-9de3-9a6c1844b9b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:28.024529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144303b-dcc0-4b98-9de3-9a6c1844b9b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:28.026308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9144303b-dcc0-4b98-9de3-9a6c1844b9b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:28.036466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144303b-dcc0-4b98-9de3-9a6c1844b9b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:28.038082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144303b-dcc0-4b98-9de3-9a6c1844b9b5 service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:28.047594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1150/2276] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:30.889872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653c375-13e7-44b7-9022-77fe8460903f service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:30.891483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3653c375-13e7-44b7-9022-77fe8460903f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:30.957811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144303b-dcc0-4b98-9de3-9a6c1844b9b5 service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:30.970970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144303b-dcc0-4b98-9de3-9a6c1844b9b5 service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:30.975881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:30.977220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:30.977700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:30.978409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] PATH_INFO: `/v3/users/cb7770b5381b44d2a018dec3a8b59143` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:30.979857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7770b5381b44d2a018dec3a8b59143)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:30.982456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:30.986508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653c375-13e7-44b7-9022-77fe8460903f service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:31.000179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f19ae-4255-4286-8834-b214b1119a23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:31.001040 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f19ae-4255-4286-8834-b214b1119a23 service placement] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:31.001499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f19ae-4255-4286-8834-b214b1119a23 service placement] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:31.001780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f19ae-4255-4286-8834-b214b1119a23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:31.003618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-207f19ae-4255-4286-8834-b214b1119a23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:31.016859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f19ae-4255-4286-8834-b214b1119a23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:31.018626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f19ae-4255-4286-8834-b214b1119a23 service placement] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:31.030048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1127/2277] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:31.041803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7770b5381b44d2a018dec3a8b59143'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:38:31.042765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7770b5381b44d2a018dec3a8b59143'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:38:31.051211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7770b5381b44d2a018dec3a8b59143'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:38:31.067510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7770b5381b44d2a018dec3a8b59143'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:38:31.075484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-272f2087-7903-4845-9a81-59356372e6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7770b5381b44d2a018dec3a8b59143'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:38:31.082048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1151/2278] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:38:30 2022] DELETE /identity/v3/users/cb7770b5381b44d2a018dec3a8b59143 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:38:31.284544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f19ae-4255-4286-8834-b214b1119a23 service placement] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:31.312761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f19ae-4255-4286-8834-b214b1119a23 service placement] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:31.390612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:31.391579 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:31.391966 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:31.392416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] PATH_INFO: `/v3/projects/36c078f96f1641c08b86ec764b349f6a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:31.393737 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c078f96f1641c08b86ec764b349f6a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:31.396403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:31.445552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c078f96f1641c08b86ec764b349f6a', 'request_id': 'req-9633ba52-612c-4716-803c-a49a9348fe63'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:38:31.451188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c078f96f1641c08b86ec764b349f6a', 'request_id': 'req-9633ba52-612c-4716-803c-a49a9348fe63'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:38:31.457715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c078f96f1641c08b86ec764b349f6a', 'request_id': 'req-9633ba52-612c-4716-803c-a49a9348fe63'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:38:31.471791 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] The token cache is being invalidate because project 36c078f96f1641c08b86ec764b349f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:38:31.472097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:38:31.472878 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:38:31.474505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1128/2279] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:38:31 2022] DELETE /identity/v3/projects/36c078f96f1641c08b86ec764b349f6a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:38:39.596494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725614ed-68e3-4579-95b3-2f97f2200757 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:39.596957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725614ed-68e3-4579-95b3-2f97f2200757 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:39.597072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725614ed-68e3-4579-95b3-2f97f2200757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:39.614293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-725614ed-68e3-4579-95b3-2f97f2200757 None None] MFA Rules not processed for user `6ca2454700fa46dbbfe0fe44bcbc266c`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:38:39.615866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-725614ed-68e3-4579-95b3-2f97f2200757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:39.670300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1152/2280] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:38:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:38:39.974845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:39.976252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:39.999362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:40.034759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ba52-612c-4716-803c-a49a9348fe63 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:40.038300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a3dae-9129-4bf1-bc05-5f1b17aa7b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:40.039003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a3dae-9129-4bf1-bc05-5f1b17aa7b60 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:40.039288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a3dae-9129-4bf1-bc05-5f1b17aa7b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:40.039568 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a3dae-9129-4bf1-bc05-5f1b17aa7b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:40.041332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e28a3dae-9129-4bf1-bc05-5f1b17aa7b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:40.050685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a3dae-9129-4bf1-bc05-5f1b17aa7b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:40.052096 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a3dae-9129-4bf1-bc05-5f1b17aa7b60 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:40.060709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1129/2281] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:40.369118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725614ed-68e3-4579-95b3-2f97f2200757 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:40.370613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-725614ed-68e3-4579-95b3-2f97f2200757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:40.442183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725614ed-68e3-4579-95b3-2f97f2200757 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:40.447763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b3663-f6ad-4cde-ad0f-2256159ebba5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:40.448414 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b3663-f6ad-4cde-ad0f-2256159ebba5 service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:40.448712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b3663-f6ad-4cde-ad0f-2256159ebba5 service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:40.448994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b3663-f6ad-4cde-ad0f-2256159ebba5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:40.450812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ab7b3663-f6ad-4cde-ad0f-2256159ebba5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:40.458755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:38:40.464147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b3663-f6ad-4cde-ad0f-2256159ebba5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:40.466555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b3663-f6ad-4cde-ad0f-2256159ebba5 service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:40.477007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1153/2282] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:44.678881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a3dae-9129-4bf1-bc05-5f1b17aa7b60 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:44.681488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e28a3dae-9129-4bf1-bc05-5f1b17aa7b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:44.753760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a3dae-9129-4bf1-bc05-5f1b17aa7b60 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:44.759658 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c510b-fa4f-4ecc-bda3-86a3cb6620d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:44.760292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c510b-fa4f-4ecc-bda3-86a3cb6620d6 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:44.760581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c510b-fa4f-4ecc-bda3-86a3cb6620d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:44.760855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c510b-fa4f-4ecc-bda3-86a3cb6620d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:44.762618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5f6c510b-fa4f-4ecc-bda3-86a3cb6620d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:44.820987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c510b-fa4f-4ecc-bda3-86a3cb6620d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:44.823345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c510b-fa4f-4ecc-bda3-86a3cb6620d6 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:44.832624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1130/2283] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:49.926580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b3663-f6ad-4cde-ad0f-2256159ebba5 service placement] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:49.927990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ab7b3663-f6ad-4cde-ad0f-2256159ebba5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:49.943436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b3663-f6ad-4cde-ad0f-2256159ebba5 service placement] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:49.948853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94455b-347f-4ee6-9d94-ce2670ad934a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:49.949490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94455b-347f-4ee6-9d94-ce2670ad934a service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:49.949775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94455b-347f-4ee6-9d94-ce2670ad934a service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:49.950050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94455b-347f-4ee6-9d94-ce2670ad934a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:49.951799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7d94455b-347f-4ee6-9d94-ce2670ad934a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:50.017858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94455b-347f-4ee6-9d94-ce2670ad934a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:50.019519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94455b-347f-4ee6-9d94-ce2670ad934a service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:50.028840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1154/2284] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:50.082971 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c510b-fa4f-4ecc-bda3-86a3cb6620d6 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:50.096714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c510b-fa4f-4ecc-bda3-86a3cb6620d6 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:50.102986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b964a6-86b8-4897-817e-c206ae606f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:50.103844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b964a6-86b8-4897-817e-c206ae606f62 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:50.104147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b964a6-86b8-4897-817e-c206ae606f62 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:50.104389 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b964a6-86b8-4897-817e-c206ae606f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:50.106230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a7b964a6-86b8-4897-817e-c206ae606f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:50.119477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b964a6-86b8-4897-817e-c206ae606f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:50.121058 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b964a6-86b8-4897-817e-c206ae606f62 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:50.131915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1131/2285] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:38:56.764299 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12ebb-a050-4266-9d85-fc54a72d803b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:56.764802 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12ebb-a050-4266-9d85-fc54a72d803b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:56.764902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12ebb-a050-4266-9d85-fc54a72d803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:56.781577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d1d12ebb-a050-4266-9d85-fc54a72d803b None None] MFA Rules not processed for user `4a4e638dc0dd459699b76df35568e795`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:38:56.782820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d1d12ebb-a050-4266-9d85-fc54a72d803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:56.790416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1155/2286] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:38:57.081995 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b964a6-86b8-4897-817e-c206ae606f62 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:38:57.091558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b964a6-86b8-4897-817e-c206ae606f62 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:38:57.095127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685a0c-b26a-4b63-b4ea-d2f9471a2487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:38:57.095755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685a0c-b26a-4b63-b4ea-d2f9471a2487 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:38:57.096040 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685a0c-b26a-4b63-b4ea-d2f9471a2487 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:38:57.096317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685a0c-b26a-4b63-b4ea-d2f9471a2487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:38:57.098069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c9685a0c-b26a-4b63-b4ea-d2f9471a2487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:38:57.108385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685a0c-b26a-4b63-b4ea-d2f9471a2487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:38:57.109833 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685a0c-b26a-4b63-b4ea-d2f9471a2487 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:38:57.118150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1132/2287] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:38:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:39:00.861115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2026200-ea35-4956-8ff1-92446daf3bfa None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:00.861579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2026200-ea35-4956-8ff1-92446daf3bfa None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:00.861671 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2026200-ea35-4956-8ff1-92446daf3bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:00.880459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e2026200-ea35-4956-8ff1-92446daf3bfa None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:00.881716 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e2026200-ea35-4956-8ff1-92446daf3bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:00.959423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1156/2288] 10.222.0.44 () {58 vars in 967 bytes} [Fri Jun 24 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:39:01.061925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685a0c-b26a-4b63-b4ea-d2f9471a2487 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:01.063937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c9685a0c-b26a-4b63-b4ea-d2f9471a2487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:01.100876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:01.136050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685a0c-b26a-4b63-b4ea-d2f9471a2487 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:01.141135 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113037ab-20c0-4fe7-b441-10cb3a176c87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:01.141780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113037ab-20c0-4fe7-b441-10cb3a176c87 service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:01.142070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113037ab-20c0-4fe7-b441-10cb3a176c87 service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:01.142377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113037ab-20c0-4fe7-b441-10cb3a176c87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:01.150487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113037ab-20c0-4fe7-b441-10cb3a176c87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:01.152069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113037ab-20c0-4fe7-b441-10cb3a176c87 service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:01.160120 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1133/2289] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:39:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:39:01.518501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2026200-ea35-4956-8ff1-92446daf3bfa None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:01.519925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e2026200-ea35-4956-8ff1-92446daf3bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:01.531142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2026200-ea35-4956-8ff1-92446daf3bfa None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:01.534664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ade25-5ae7-4661-ac8e-9f489beea5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:01.535297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ade25-5ae7-4661-ac8e-9f489beea5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:01.535579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ade25-5ae7-4661-ac8e-9f489beea5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:01.535852 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ade25-5ae7-4661-ac8e-9f489beea5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:01.537542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bb8ade25-5ae7-4661-ac8e-9f489beea5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:01.604514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ade25-5ae7-4661-ac8e-9f489beea5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:01.605967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ade25-5ae7-4661-ac8e-9f489beea5f9 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:01.615845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1157/2290] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:39:08.905605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113037ab-20c0-4fe7-b441-10cb3a176c87 service swift] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:08.909152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-113037ab-20c0-4fe7-b441-10cb3a176c87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:08.931925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113037ab-20c0-4fe7-b441-10cb3a176c87 service swift] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:08.937874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:08.938858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:08.939674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:08.940030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] PATH_INFO: `/v3/users/445c6c39470d4fc3b7c72447effd9c5a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:08.941317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445c6c39470d4fc3b7c72447effd9c5a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:08.943591 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:09.004160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445c6c39470d4fc3b7c72447effd9c5a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.004868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445c6c39470d4fc3b7c72447effd9c5a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.005533 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445c6c39470d4fc3b7c72447effd9c5a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.022600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445c6c39470d4fc3b7c72447effd9c5a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.030431 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445c6c39470d4fc3b7c72447effd9c5a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.047686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1134/2291] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:39:08 2022] DELETE /identity/v3/users/445c6c39470d4fc3b7c72447effd9c5a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:09.298994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ade25-5ae7-4661-ac8e-9f489beea5f9 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:09.312786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ade25-5ae7-4661-ac8e-9f489beea5f9 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:09.337985 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:09.378099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:09.379014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:09.379344 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:09.379690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] PATH_INFO: `/v3/projects/6154e621887f40cb9c844ac9eb5beeed` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:09.381016 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6154e621887f40cb9c844ac9eb5beeed)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:09.382966 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:09.436048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6154e621887f40cb9c844ac9eb5beeed', 'request_id': 'req-7ea1b768-b7c1-49dd-89d5-012bae03f44b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.451014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6154e621887f40cb9c844ac9eb5beeed', 'request_id': 'req-7ea1b768-b7c1-49dd-89d5-012bae03f44b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.456810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6154e621887f40cb9c844ac9eb5beeed', 'request_id': 'req-7ea1b768-b7c1-49dd-89d5-012bae03f44b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.471740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] The token cache is being invalidate because project 6154e621887f40cb9c844ac9eb5beeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:39:09.472032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.472711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.474301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1158/2292] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:39:09 2022] DELETE /identity/v3/projects/6154e621887f40cb9c844ac9eb5beeed => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:09.478736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:09.480997 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:09.494655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5714b1a-5da5-4bfc-b9f0-694f269cbd21 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:09.553594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:09.554614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:09.554904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:09.555206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] PATH_INFO: `/v3/users/1259a413fdb7499ab01e89475c3d4369` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:09.556397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1259a413fdb7499ab01e89475c3d4369)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:09.558309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:09.601753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:09.611769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1259a413fdb7499ab01e89475c3d4369'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.612527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1259a413fdb7499ab01e89475c3d4369'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.613146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1259a413fdb7499ab01e89475c3d4369'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.625871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1259a413fdb7499ab01e89475c3d4369'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.633337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9671da2c-4156-43b6-910a-ee0ead5b8539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1259a413fdb7499ab01e89475c3d4369'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:09.646130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1135/2293] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:39:09 2022] DELETE /identity/v3/users/1259a413fdb7499ab01e89475c3d4369 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:09.908756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:09.910330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:09.923775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1b768-b7c1-49dd-89d5-012bae03f44b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:09.980911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:09.981770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:09.982056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:09.982335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] PATH_INFO: `/v3/projects/28fb076a0c3a49a0a9baf49f724c145c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:09.983568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28fb076a0c3a49a0a9baf49f724c145c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:09.985514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:10.031638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28fb076a0c3a49a0a9baf49f724c145c', 'request_id': 'req-b060de6d-0eaa-459b-83c4-a834d932f966'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:10.038976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28fb076a0c3a49a0a9baf49f724c145c', 'request_id': 'req-b060de6d-0eaa-459b-83c4-a834d932f966'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:10.040169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:10.046213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28fb076a0c3a49a0a9baf49f724c145c', 'request_id': 'req-b060de6d-0eaa-459b-83c4-a834d932f966'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:10.059113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] The token cache is being invalidate because project 28fb076a0c3a49a0a9baf49f724c145c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:39:10.059404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:10.060032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:10.061544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1159/2294] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:39:09 2022] DELETE /identity/v3/projects/28fb076a0c3a49a0a9baf49f724c145c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:19.642575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=15,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:20.056104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=2,keystone:SELECT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:44.789223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4fb4f-a862-4b68-9562-3c11dd9c1852 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:44.789771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4fb4f-a862-4b68-9562-3c11dd9c1852 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:44.789771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4fb4f-a862-4b68-9562-3c11dd9c1852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:44.807603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7db4fb4f-a862-4b68-9562-3c11dd9c1852 None None] MFA Rules not processed for user `1b925b5e87dc489db1dd5e994e47e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:44.808897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7db4fb4f-a862-4b68-9562-3c11dd9c1852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:44.864224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1136/2295] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:39:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:39:54.852692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:54.854140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:54.857594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=25 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:54.920467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060de6d-0eaa-459b-83c4-a834d932f966 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:54.924122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483c1ef-0152-415b-b00a-219d2022ab87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:54.924773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483c1ef-0152-415b-b00a-219d2022ab87 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:54.925059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483c1ef-0152-415b-b00a-219d2022ab87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:54.925335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483c1ef-0152-415b-b00a-219d2022ab87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:54.927142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e483c1ef-0152-415b-b00a-219d2022ab87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:54.988798 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483c1ef-0152-415b-b00a-219d2022ab87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:54.990226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483c1ef-0152-415b-b00a-219d2022ab87 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:55.000744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1160/2296] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:39:58.130335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4fb4f-a862-4b68-9562-3c11dd9c1852 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.132033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7db4fb4f-a862-4b68-9562-3c11dd9c1852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:58.185163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483c1ef-0152-415b-b00a-219d2022ab87 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.186659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e483c1ef-0152-415b-b00a-219d2022ab87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:58.204951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483c1ef-0152-415b-b00a-219d2022ab87 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:58.210260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:58.211184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.211596 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.211904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] PATH_INFO: `/v3/users/6e971595d77647dca5a29a5574c6627d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.213142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e971595d77647dca5a29a5574c6627d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:58.215130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:58.215595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4fb4f-a862-4b68-9562-3c11dd9c1852 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:58.220739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396de8-6c84-47a5-846e-589742dfb4f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:58.221414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396de8-6c84-47a5-846e-589742dfb4f0 service placement] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.221699 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396de8-6c84-47a5-846e-589742dfb4f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.221978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f396de8-6c84-47a5-846e-589742dfb4f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.223788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6f396de8-6c84-47a5-846e-589742dfb4f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:58.238240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f396de8-6c84-47a5-846e-589742dfb4f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:58.239860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f396de8-6c84-47a5-846e-589742dfb4f0 service placement] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:58.256251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1137/2297] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:39:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:39:58.274532 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e971595d77647dca5a29a5574c6627d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:58.275213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e971595d77647dca5a29a5574c6627d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:58.286338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e971595d77647dca5a29a5574c6627d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:58.310962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e971595d77647dca5a29a5574c6627d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:58.318550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a6294582-7110-443f-aebe-7751d3b69853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e971595d77647dca5a29a5574c6627d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:58.327939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1161/2298] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:39:58 2022] DELETE /identity/v3/users/6e971595d77647dca5a29a5574c6627d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:58.510270 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396de8-6c84-47a5-846e-589742dfb4f0 service placement] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.522869 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f396de8-6c84-47a5-846e-589742dfb4f0 service placement] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:58.587083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:58.587988 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.588253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.588526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] PATH_INFO: `/v3/projects/845bbc7de6b94e6389d9bf5e1f6c6586` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.589700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=845bbc7de6b94e6389d9bf5e1f6c6586)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:58.591911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:58.642807 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845bbc7de6b94e6389d9bf5e1f6c6586', 'request_id': 'req-8b458148-3ea2-41f2-8f30-212ef9c33d99'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:58.648276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845bbc7de6b94e6389d9bf5e1f6c6586', 'request_id': 'req-8b458148-3ea2-41f2-8f30-212ef9c33d99'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:58.655170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845bbc7de6b94e6389d9bf5e1f6c6586', 'request_id': 'req-8b458148-3ea2-41f2-8f30-212ef9c33d99'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:58.667531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] The token cache is being invalidate because project 845bbc7de6b94e6389d9bf5e1f6c6586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:39:58.667823 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:58.668521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8b458148-3ea2-41f2-8f30-212ef9c33d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:39:58.670140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1138/2299] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:39:58 2022] DELETE /identity/v3/projects/845bbc7de6b94e6389d9bf5e1f6c6586 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:58.675336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eeb1a-9faa-40ba-a5eb-425738479bb9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.675711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eeb1a-9faa-40ba-a5eb-425738479bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.676052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eeb1a-9faa-40ba-a5eb-425738479bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.693950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-e46eeb1a-9faa-40ba-a5eb-425738479bb9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:58.695208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e46eeb1a-9faa-40ba-a5eb-425738479bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:58.715714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:58.762323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1162/2300] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:39:58.770142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05727-1393-41e9-8d37-ae5402602a1e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.770461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05727-1393-41e9-8d37-ae5402602a1e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.770766 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05727-1393-41e9-8d37-ae5402602a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.791366 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-70e05727-1393-41e9-8d37-ae5402602a1e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:58.792612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-70e05727-1393-41e9-8d37-ae5402602a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:58.803875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1139/2301] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:39:58.805557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46eeb1a-9faa-40ba-a5eb-425738479bb9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.815729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46eeb1a-9faa-40ba-a5eb-425738479bb9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:58.820585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a563dc1-5acc-4dfb-8a36-0fc3135646cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:58.821759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563dc1-5acc-4dfb-8a36-0fc3135646cc admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.822049 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563dc1-5acc-4dfb-8a36-0fc3135646cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.822324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563dc1-5acc-4dfb-8a36-0fc3135646cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.823109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a563dc1-5acc-4dfb-8a36-0fc3135646cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:39:58.823417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a563dc1-5acc-4dfb-8a36-0fc3135646cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:58.825036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a563dc1-5acc-4dfb-8a36-0fc3135646cc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:58.838184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1163/2302] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:39:58.842652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e05727-1393-41e9-8d37-ae5402602a1e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.852339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e05727-1393-41e9-8d37-ae5402602a1e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:58.857302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984741d7-b1ff-4cd0-bcfa-814bdffacfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:58.857994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984741d7-b1ff-4cd0-bcfa-814bdffacfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.858298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984741d7-b1ff-4cd0-bcfa-814bdffacfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.858591 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984741d7-b1ff-4cd0-bcfa-814bdffacfa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.859560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984741d7-b1ff-4cd0-bcfa-814bdffacfa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:58.862616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984741d7-b1ff-4cd0-bcfa-814bdffacfa6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:58.875907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:58.904765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1140/2303] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:39:58 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:39:58.908767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a563dc1-5acc-4dfb-8a36-0fc3135646cc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:58.918893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a563dc1-5acc-4dfb-8a36-0fc3135646cc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:58.975375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a2362-5d70-4e9d-ba5c-5177ed9999b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:58.976037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2362-5d70-4e9d-ba5c-5177ed9999b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:58.976321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2362-5d70-4e9d-ba5c-5177ed9999b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:58.976601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2362-5d70-4e9d-ba5c-5177ed9999b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:58.977374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a2362-5d70-4e9d-ba5c-5177ed9999b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:58.979326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a2362-5d70-4e9d-ba5c-5177ed9999b2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:58.999775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1164/2304] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:39:58 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:59.003924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984741d7-b1ff-4cd0-bcfa-814bdffacfa6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.014724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984741d7-b1ff-4cd0-bcfa-814bdffacfa6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.019268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4774139-e902-4b11-b97c-ba8208ed2afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.019913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4774139-e902-4b11-b97c-ba8208ed2afe admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.020195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4774139-e902-4b11-b97c-ba8208ed2afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.020469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4774139-e902-4b11-b97c-ba8208ed2afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.021190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4774139-e902-4b11-b97c-ba8208ed2afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.022991 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4774139-e902-4b11-b97c-ba8208ed2afe admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.033021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1141/2305] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:39:59.036812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a2362-5d70-4e9d-ba5c-5177ed9999b2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.046929 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a2362-5d70-4e9d-ba5c-5177ed9999b2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.051463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce46308-78db-4fc9-a905-16272cabb461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.052116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46308-78db-4fc9-a905-16272cabb461 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.052398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46308-78db-4fc9-a905-16272cabb461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.052669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46308-78db-4fc9-a905-16272cabb461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.053385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce46308-78db-4fc9-a905-16272cabb461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.055557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce46308-78db-4fc9-a905-16272cabb461 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.065568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1165/2306] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:39:59.069709 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4774139-e902-4b11-b97c-ba8208ed2afe admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.080475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4774139-e902-4b11-b97c-ba8208ed2afe admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.085081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e51110-2921-43e3-a430-07731ceef720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.085941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e51110-2921-43e3-a430-07731ceef720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.086225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e51110-2921-43e3-a430-07731ceef720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.086574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e51110-2921-43e3-a430-07731ceef720 admin admin] PATH_INFO: `/v3/projects/7dfa6b8044fc4b42881326bbc5900f4c/users/baf8404d17c74dbcb77404ea306a8c8a/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.100761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e51110-2921-43e3-a430-07731ceef720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfa6b8044fc4b42881326bbc5900f4c, user_id=baf8404d17c74dbcb77404ea306a8c8a, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.103421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e51110-2921-43e3-a430-07731ceef720 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.117423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1142/2307] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:39:59 2022] PUT /identity/v3/projects/7dfa6b8044fc4b42881326bbc5900f4c/users/baf8404d17c74dbcb77404ea306a8c8a/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:59.127856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18053614-c75c-4992-aba9-b58b35491392 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.128150 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18053614-c75c-4992-aba9-b58b35491392 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.128433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18053614-c75c-4992-aba9-b58b35491392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.154933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-18053614-c75c-4992-aba9-b58b35491392 None None] MFA Rules not processed for user `baf8404d17c74dbcb77404ea306a8c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:59.156200 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-18053614-c75c-4992-aba9-b58b35491392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:59.220324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1166/2308] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:39:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:39:59.224678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e51110-2921-43e3-a430-07731ceef720 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.285323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e51110-2921-43e3-a430-07731ceef720 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.290456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6c163-1691-4c61-aaf7-0ab030fcceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.291053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6c163-1691-4c61-aaf7-0ab030fcceb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.291335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6c163-1691-4c61-aaf7-0ab030fcceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.291610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6c163-1691-4c61-aaf7-0ab030fcceb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.292296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6c163-1691-4c61-aaf7-0ab030fcceb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.294175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6c163-1691-4c61-aaf7-0ab030fcceb4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.319076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1143/2309] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:39:59 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:59.323155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18053614-c75c-4992-aba9-b58b35491392 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.333620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18053614-c75c-4992-aba9-b58b35491392 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.345743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:59.395072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57417bf-35da-404e-82e0-107410239289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.395637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57417bf-35da-404e-82e0-107410239289 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.395919 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57417bf-35da-404e-82e0-107410239289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.396194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57417bf-35da-404e-82e0-107410239289 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.396873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57417bf-35da-404e-82e0-107410239289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.398804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57417bf-35da-404e-82e0-107410239289 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.418690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1167/2310] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:39:59 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:39:59.422932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6c163-1691-4c61-aaf7-0ab030fcceb4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.433971 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6c163-1691-4c61-aaf7-0ab030fcceb4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.440484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e9546-18ba-49fb-8d6c-64bc11b115e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.441242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e9546-18ba-49fb-8d6c-64bc11b115e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.441527 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e9546-18ba-49fb-8d6c-64bc11b115e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.441803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e9546-18ba-49fb-8d6c-64bc11b115e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.442565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e9546-18ba-49fb-8d6c-64bc11b115e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.444158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e9546-18ba-49fb-8d6c-64bc11b115e7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.455096 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1144/2311] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:39:59.459387 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57417bf-35da-404e-82e0-107410239289 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.469538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57417bf-35da-404e-82e0-107410239289 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.474167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062eb40-0ca4-494c-b939-4e72d65eed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.475089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062eb40-0ca4-494c-b939-4e72d65eed56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.475370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062eb40-0ca4-494c-b939-4e72d65eed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.475650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062eb40-0ca4-494c-b939-4e72d65eed56 admin admin] PATH_INFO: `/v3/projects/fcaf6b738e0d4d3eb1c3fb08f3b38696/users/0a43d336b2cf41ecbfdb5f2e1ccb74e7/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.491056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062eb40-0ca4-494c-b939-4e72d65eed56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcaf6b738e0d4d3eb1c3fb08f3b38696, user_id=0a43d336b2cf41ecbfdb5f2e1ccb74e7, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.494609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062eb40-0ca4-494c-b939-4e72d65eed56 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.507999 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1168/2312] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:39:59 2022] PUT /identity/v3/projects/fcaf6b738e0d4d3eb1c3fb08f3b38696/users/0a43d336b2cf41ecbfdb5f2e1ccb74e7/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:59.512011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e9546-18ba-49fb-8d6c-64bc11b115e7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.522104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e9546-18ba-49fb-8d6c-64bc11b115e7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.585744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0566b7-a0e4-4bc0-9e82-622a6de5df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.586487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0566b7-a0e4-4bc0-9e82-622a6de5df6a admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.586773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0566b7-a0e4-4bc0-9e82-622a6de5df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.587210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0566b7-a0e4-4bc0-9e82-622a6de5df6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.587771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0566b7-a0e4-4bc0-9e82-622a6de5df6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.589353 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0566b7-a0e4-4bc0-9e82-622a6de5df6a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.601378 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1145/2313] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:39:59.604159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062eb40-0ca4-494c-b939-4e72d65eed56 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.614451 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062eb40-0ca4-494c-b939-4e72d65eed56 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.619864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703316f-be62-4a70-a6ba-c032c63b37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.620750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703316f-be62-4a70-a6ba-c032c63b37d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.621012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703316f-be62-4a70-a6ba-c032c63b37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.621285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703316f-be62-4a70-a6ba-c032c63b37d5 admin admin] PATH_INFO: `/v3/projects/fcaf6b738e0d4d3eb1c3fb08f3b38696/users/0a43d336b2cf41ecbfdb5f2e1ccb74e7/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.623377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703316f-be62-4a70-a6ba-c032c63b37d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcaf6b738e0d4d3eb1c3fb08f3b38696, user_id=0a43d336b2cf41ecbfdb5f2e1ccb74e7, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.626204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703316f-be62-4a70-a6ba-c032c63b37d5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.636902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1169/2314] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:39:59 2022] PUT /identity/v3/projects/fcaf6b738e0d4d3eb1c3fb08f3b38696/users/0a43d336b2cf41ecbfdb5f2e1ccb74e7/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:39:59.648198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c87b8-f662-41b5-90f3-972bbaf0bf89 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.648410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c87b8-f662-41b5-90f3-972bbaf0bf89 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.648686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c87b8-f662-41b5-90f3-972bbaf0bf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.679024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a77c87b8-f662-41b5-90f3-972bbaf0bf89 None None] MFA Rules not processed for user `0a43d336b2cf41ecbfdb5f2e1ccb74e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:39:59.680296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a77c87b8-f662-41b5-90f3-972bbaf0bf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:59.685740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:39:59.759379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1146/2315] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:39:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:39:59.770590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703316f-be62-4a70-a6ba-c032c63b37d5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.772352 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a703316f-be62-4a70-a6ba-c032c63b37d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:39:59.841035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703316f-be62-4a70-a6ba-c032c63b37d5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.844737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfa03d-3467-4980-8ec2-b926f359741d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.845466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfa03d-3467-4980-8ec2-b926f359741d service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.845753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfa03d-3467-4980-8ec2-b926f359741d service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.846028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfa03d-3467-4980-8ec2-b926f359741d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:39:59.855487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfa03d-3467-4980-8ec2-b926f359741d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:39:59.856912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfa03d-3467-4980-8ec2-b926f359741d service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:39:59.866744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1170/2316] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:39:59.939521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c87b8-f662-41b5-90f3-972bbaf0bf89 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:39:59.949624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c87b8-f662-41b5-90f3-972bbaf0bf89 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:39:59.953279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b0c01-c90c-4822-969e-e6ebb40c75e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:39:59.953914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b0c01-c90c-4822-969e-e6ebb40c75e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:39:59.954195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b0c01-c90c-4822-969e-e6ebb40c75e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:39:59.954505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b0c01-c90c-4822-969e-e6ebb40c75e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:00.012653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b0c01-c90c-4822-969e-e6ebb40c75e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:00.014115 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b0c01-c90c-4822-969e-e6ebb40c75e8 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:00.023501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1147/2317] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:39:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:09.862208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:10.019192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=54 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:23.190556 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfa03d-3467-4980-8ec2-b926f359741d service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:23.191949 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e2dfa03d-3467-4980-8ec2-b926f359741d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:23.261784 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfa03d-3467-4980-8ec2-b926f359741d service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:23.266806 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa4d31-95a7-4a1b-bee1-f177b7eb4a1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:23.267462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa4d31-95a7-4a1b-bee1-f177b7eb4a1d service placement] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:23.267742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa4d31-95a7-4a1b-bee1-f177b7eb4a1d service placement] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:23.268037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa4d31-95a7-4a1b-bee1-f177b7eb4a1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:23.269784 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ddaa4d31-95a7-4a1b-bee1-f177b7eb4a1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:23.281850 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa4d31-95a7-4a1b-bee1-f177b7eb4a1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:23.284234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa4d31-95a7-4a1b-bee1-f177b7eb4a1d service placement] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:23.294130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1171/2318] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:30.907325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b0c01-c90c-4822-969e-e6ebb40c75e8 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:30.967979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b0c01-c90c-4822-969e-e6ebb40c75e8 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:30.972488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:30.973352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:30.973629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:30.973903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] PATH_INFO: `/v3/users/baf8404d17c74dbcb77404ea306a8c8a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:30.979304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf8404d17c74dbcb77404ea306a8c8a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:30.981220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:31.025035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf8404d17c74dbcb77404ea306a8c8a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.025677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf8404d17c74dbcb77404ea306a8c8a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.027123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf8404d17c74dbcb77404ea306a8c8a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.038880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf8404d17c74dbcb77404ea306a8c8a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.045695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf8404d17c74dbcb77404ea306a8c8a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.058223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1148/2319] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:40:30 2022] DELETE /identity/v3/users/baf8404d17c74dbcb77404ea306a8c8a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:31.062842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b0c70-0f2b-493b-a621-45d1813cff00 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.063379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b0c70-0f2b-493b-a621-45d1813cff00 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.063478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b0c70-0f2b-493b-a621-45d1813cff00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.081246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c50b0c70-0f2b-493b-a621-45d1813cff00 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:31.082557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c50b0c70-0f2b-493b-a621-45d1813cff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:31.140302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1172/2320] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:31.149858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.151254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:31.206849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d4534-b8f6-494b-ba25-926f95810691 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.210794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdeff8-d425-4a0b-80ef-34a44577576d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.211427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdeff8-d425-4a0b-80ef-34a44577576d service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.211711 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdeff8-d425-4a0b-80ef-34a44577576d service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.211986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdeff8-d425-4a0b-80ef-34a44577576d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.221172 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdeff8-d425-4a0b-80ef-34a44577576d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:31.222605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdeff8-d425-4a0b-80ef-34a44577576d service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:31.231931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1149/2321] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:31.495697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b0c70-0f2b-493b-a621-45d1813cff00 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.497224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c50b0c70-0f2b-493b-a621-45d1813cff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:31.509256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b0c70-0f2b-493b-a621-45d1813cff00 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.518983 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.519881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.520170 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.520584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] PATH_INFO: `/v3/projects/7dfa6b8044fc4b42881326bbc5900f4c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.521993 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfa6b8044fc4b42881326bbc5900f4c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:31.523958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:31.573913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfa6b8044fc4b42881326bbc5900f4c', 'request_id': 'req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.581367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfa6b8044fc4b42881326bbc5900f4c', 'request_id': 'req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.586996 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfa6b8044fc4b42881326bbc5900f4c', 'request_id': 'req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.597775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] The token cache is being invalidate because project 7dfa6b8044fc4b42881326bbc5900f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:40:31.598061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.598686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.600258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1173/2322] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:40:31 2022] DELETE /identity/v3/projects/7dfa6b8044fc4b42881326bbc5900f4c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:31.604853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdeff8-d425-4a0b-80ef-34a44577576d service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:31.614264 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdeff8-d425-4a0b-80ef-34a44577576d service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:31.632622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:31.671872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:31.672761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:31.673039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:31.673310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] PATH_INFO: `/v3/users/0a43d336b2cf41ecbfdb5f2e1ccb74e7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:31.674495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a43d336b2cf41ecbfdb5f2e1ccb74e7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:31.676470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:31.720099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a43d336b2cf41ecbfdb5f2e1ccb74e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.720744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a43d336b2cf41ecbfdb5f2e1ccb74e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.721354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a43d336b2cf41ecbfdb5f2e1ccb74e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.734190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a43d336b2cf41ecbfdb5f2e1ccb74e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.740860 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-46426075-3539-452b-a18b-a0e0b9804c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a43d336b2cf41ecbfdb5f2e1ccb74e7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:31.754996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1150/2323] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:40:31 2022] DELETE /identity/v3/users/0a43d336b2cf41ecbfdb5f2e1ccb74e7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:32.035126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.036544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:32.049810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98832de9-fde8-4b30-83ed-9e5e5d6e4a19 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.058899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.106536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.107355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.107656 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.107930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] PATH_INFO: `/v3/projects/fcaf6b738e0d4d3eb1c3fb08f3b38696` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.109098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcaf6b738e0d4d3eb1c3fb08f3b38696)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.111053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.157376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcaf6b738e0d4d3eb1c3fb08f3b38696', 'request_id': 'req-6038fd4f-44fe-4f8a-835f-7bb6be789d59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:32.164224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcaf6b738e0d4d3eb1c3fb08f3b38696', 'request_id': 'req-6038fd4f-44fe-4f8a-835f-7bb6be789d59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:32.170573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcaf6b738e0d4d3eb1c3fb08f3b38696', 'request_id': 'req-6038fd4f-44fe-4f8a-835f-7bb6be789d59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:32.181810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] The token cache is being invalidate because project fcaf6b738e0d4d3eb1c3fb08f3b38696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:40:32.182095 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:32.182713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6038fd4f-44fe-4f8a-835f-7bb6be789d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:32.184388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1174/2324] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:40:32 2022] DELETE /identity/v3/projects/fcaf6b738e0d4d3eb1c3fb08f3b38696 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:32.190591 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf274-b432-4ec5-bdb6-6acf9b1f0f3d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.191099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf274-b432-4ec5-bdb6-6acf9b1f0f3d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.191202 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf274-b432-4ec5-bdb6-6acf9b1f0f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.208092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-709cf274-b432-4ec5-bdb6-6acf9b1f0f3d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:32.209306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-709cf274-b432-4ec5-bdb6-6acf9b1f0f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:32.267648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1151/2325] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:32.275485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920dc89-7c48-4520-9b06-6211faa6f070 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.275818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920dc89-7c48-4520-9b06-6211faa6f070 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.276613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920dc89-7c48-4520-9b06-6211faa6f070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.294450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4920dc89-7c48-4520-9b06-6211faa6f070 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:32.295654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4920dc89-7c48-4520-9b06-6211faa6f070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:32.305666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1175/2326] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:32.309477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cf274-b432-4ec5-bdb6-6acf9b1f0f3d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.319161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cf274-b432-4ec5-bdb6-6acf9b1f0f3d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.324206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfc572-7040-4712-a46d-ee4ec93713d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.324852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfc572-7040-4712-a46d-ee4ec93713d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.325139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfc572-7040-4712-a46d-ee4ec93713d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.325414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfc572-7040-4712-a46d-ee4ec93713d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.326138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfc572-7040-4712-a46d-ee4ec93713d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:32.326477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfc572-7040-4712-a46d-ee4ec93713d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.328068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfc572-7040-4712-a46d-ee4ec93713d0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.340440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1152/2327] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:32.344471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920dc89-7c48-4520-9b06-6211faa6f070 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.353675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920dc89-7c48-4520-9b06-6211faa6f070 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.358330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e17f4-6f37-4f23-a5d0-b35e5f00523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.358955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e17f4-6f37-4f23-a5d0-b35e5f00523c admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.359245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e17f4-6f37-4f23-a5d0-b35e5f00523c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.359526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e17f4-6f37-4f23-a5d0-b35e5f00523c admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.360223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e17f4-6f37-4f23-a5d0-b35e5f00523c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.362141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e17f4-6f37-4f23-a5d0-b35e5f00523c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.390338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1176/2328] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:40:32 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:32.391460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfc572-7040-4712-a46d-ee4ec93713d0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.402047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfc572-7040-4712-a46d-ee4ec93713d0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.427143 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.459371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe85e54-06e4-458f-99b3-bf5f4a06aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.460030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe85e54-06e4-458f-99b3-bf5f4a06aaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.460314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe85e54-06e4-458f-99b3-bf5f4a06aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.460593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe85e54-06e4-458f-99b3-bf5f4a06aaf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.461266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe85e54-06e4-458f-99b3-bf5f4a06aaf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.463815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe85e54-06e4-458f-99b3-bf5f4a06aaf7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.485598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1153/2329] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:40:32 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:40:32.486810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e17f4-6f37-4f23-a5d0-b35e5f00523c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.497351 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e17f4-6f37-4f23-a5d0-b35e5f00523c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.502033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2576b-c134-4c06-83cf-035af593ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.502731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2576b-c134-4c06-83cf-035af593ab63 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.503017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2576b-c134-4c06-83cf-035af593ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.503295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2576b-c134-4c06-83cf-035af593ab63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.504021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2576b-c134-4c06-83cf-035af593ab63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.505618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2576b-c134-4c06-83cf-035af593ab63 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.516433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1177/2330] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:40:32.520188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe85e54-06e4-458f-99b3-bf5f4a06aaf7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.530848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe85e54-06e4-458f-99b3-bf5f4a06aaf7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.535474 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c16591-39e8-4032-9856-909a7a83cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.536119 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c16591-39e8-4032-9856-909a7a83cdad admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.536410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c16591-39e8-4032-9856-909a7a83cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.536692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c16591-39e8-4032-9856-909a7a83cdad admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.537433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c16591-39e8-4032-9856-909a7a83cdad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.539061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c16591-39e8-4032-9856-909a7a83cdad admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.548914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1154/2331] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:40:32.552675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2576b-c134-4c06-83cf-035af593ab63 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.562467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2576b-c134-4c06-83cf-035af593ab63 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.567058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a1f69-2662-4890-b0e5-deaf805171d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.567934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a1f69-2662-4890-b0e5-deaf805171d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.568216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a1f69-2662-4890-b0e5-deaf805171d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.568491 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a1f69-2662-4890-b0e5-deaf805171d0 admin admin] PATH_INFO: `/v3/projects/8e2b95f3a42745fa9328ae0e18f9169e/users/983258e456df4a2d950fc108cda3fb7a/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.584857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a1f69-2662-4890-b0e5-deaf805171d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2b95f3a42745fa9328ae0e18f9169e, user_id=983258e456df4a2d950fc108cda3fb7a, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.587547 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a1f69-2662-4890-b0e5-deaf805171d0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.601179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1178/2332] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:40:32 2022] PUT /identity/v3/projects/8e2b95f3a42745fa9328ae0e18f9169e/users/983258e456df4a2d950fc108cda3fb7a/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:32.612459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ddcd3-46a4-4be8-a149-a543afd4e911 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.612692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ddcd3-46a4-4be8-a149-a543afd4e911 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.612974 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ddcd3-46a4-4be8-a149-a543afd4e911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.639732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-4f5ddcd3-46a4-4be8-a149-a543afd4e911 None None] MFA Rules not processed for user `983258e456df4a2d950fc108cda3fb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:32.640919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4f5ddcd3-46a4-4be8-a149-a543afd4e911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:32.702422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1155/2333] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:32.706954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a1f69-2662-4890-b0e5-deaf805171d0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.748322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:32.768368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a1f69-2662-4890-b0e5-deaf805171d0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.772913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0aa5c-b376-42c1-b3ec-471d721e7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.773559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0aa5c-b376-42c1-b3ec-471d721e7da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.773841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0aa5c-b376-42c1-b3ec-471d721e7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.774112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0aa5c-b376-42c1-b3ec-471d721e7da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.774817 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0aa5c-b376-42c1-b3ec-471d721e7da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.776761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0aa5c-b376-42c1-b3ec-471d721e7da0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.800581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1179/2334] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:40:32 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:32.804582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ddcd3-46a4-4be8-a149-a543afd4e911 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.815625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ddcd3-46a4-4be8-a149-a543afd4e911 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.871633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19077cc9-f945-4737-b9cc-59452199c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.872322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19077cc9-f945-4737-b9cc-59452199c933 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.872613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19077cc9-f945-4737-b9cc-59452199c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.872892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19077cc9-f945-4737-b9cc-59452199c933 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.873586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19077cc9-f945-4737-b9cc-59452199c933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.875536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19077cc9-f945-4737-b9cc-59452199c933 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.895815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1156/2335] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:40:32 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:32.899779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0aa5c-b376-42c1-b3ec-471d721e7da0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.909995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0aa5c-b376-42c1-b3ec-471d721e7da0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.914560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf77e8-e5b2-49b5-a0d2-99ee973f9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.915212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf77e8-e5b2-49b5-a0d2-99ee973f9f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.915493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf77e8-e5b2-49b5-a0d2-99ee973f9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.915770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf77e8-e5b2-49b5-a0d2-99ee973f9f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.916516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf77e8-e5b2-49b5-a0d2-99ee973f9f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.918108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf77e8-e5b2-49b5-a0d2-99ee973f9f34 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.928765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1180/2336] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:40:32.933291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19077cc9-f945-4737-b9cc-59452199c933 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.943254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19077cc9-f945-4737-b9cc-59452199c933 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:32.948401 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf7c1-8271-4d20-9f6e-6f639d04dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:32.949272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf7c1-8271-4d20-9f6e-6f639d04dc56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:32.949555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf7c1-8271-4d20-9f6e-6f639d04dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:32.949832 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf7c1-8271-4d20-9f6e-6f639d04dc56 admin admin] PATH_INFO: `/v3/projects/8edaaafb7f3042109e21c98c3f82620e/users/56943e9f964a4b73ab6f7d0cb392adde/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:32.964357 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf7c1-8271-4d20-9f6e-6f639d04dc56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edaaafb7f3042109e21c98c3f82620e, user_id=56943e9f964a4b73ab6f7d0cb392adde, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:32.967091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf7c1-8271-4d20-9f6e-6f639d04dc56 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:32.980164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1157/2337] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:40:32 2022] PUT /identity/v3/projects/8edaaafb7f3042109e21c98c3f82620e/users/56943e9f964a4b73ab6f7d0cb392adde/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:40:32.984059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf77e8-e5b2-49b5-a0d2-99ee973f9f34 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:32.995082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf77e8-e5b2-49b5-a0d2-99ee973f9f34 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.049999 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4ff2d-0d02-47dc-8dff-0f3f0bb8123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.050688 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4ff2d-0d02-47dc-8dff-0f3f0bb8123f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.050978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4ff2d-0d02-47dc-8dff-0f3f0bb8123f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.051259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4ff2d-0d02-47dc-8dff-0f3f0bb8123f admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.051988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4ff2d-0d02-47dc-8dff-0f3f0bb8123f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.053591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4ff2d-0d02-47dc-8dff-0f3f0bb8123f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.063861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1181/2338] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:40:33.068125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf7c1-8271-4d20-9f6e-6f639d04dc56 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.073509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.080321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf7c1-8271-4d20-9f6e-6f639d04dc56 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.085434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9fe39-32f2-4462-bc68-403191835014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.086335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9fe39-32f2-4462-bc68-403191835014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.086659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9fe39-32f2-4462-bc68-403191835014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.086938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9fe39-32f2-4462-bc68-403191835014 admin admin] PATH_INFO: `/v3/projects/8edaaafb7f3042109e21c98c3f82620e/users/56943e9f964a4b73ab6f7d0cb392adde/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.088911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9fe39-32f2-4462-bc68-403191835014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edaaafb7f3042109e21c98c3f82620e, user_id=56943e9f964a4b73ab6f7d0cb392adde, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.091565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9fe39-32f2-4462-bc68-403191835014 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.101791 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1158/2339] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:40:33 2022] PUT /identity/v3/projects/8edaaafb7f3042109e21c98c3f82620e/users/56943e9f964a4b73ab6f7d0cb392adde/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:33.112344 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe0357-3802-4058-9ad8-c2076b22be18 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.112828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe0357-3802-4058-9ad8-c2076b22be18 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.112944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe0357-3802-4058-9ad8-c2076b22be18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.139605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-22fe0357-3802-4058-9ad8-c2076b22be18 None None] MFA Rules not processed for user `56943e9f964a4b73ab6f7d0cb392adde`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:33.140741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-22fe0357-3802-4058-9ad8-c2076b22be18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:33.207109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1182/2340] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:33.218413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9fe39-32f2-4462-bc68-403191835014 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.220145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f4c9fe39-32f2-4462-bc68-403191835014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:33.277431 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9fe39-32f2-4462-bc68-403191835014 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.281155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b7e91-4106-469c-9723-a5d071d1eee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.281792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b7e91-4106-469c-9723-a5d071d1eee7 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.282071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b7e91-4106-469c-9723-a5d071d1eee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.282391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b7e91-4106-469c-9723-a5d071d1eee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.291234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b7e91-4106-469c-9723-a5d071d1eee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.293201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b7e91-4106-469c-9723-a5d071d1eee7 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.302392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1159/2341] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:33.381004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe0357-3802-4058-9ad8-c2076b22be18 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:33.390678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe0357-3802-4058-9ad8-c2076b22be18 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:33.394190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2cc66-fb77-4dde-ba03-891895b1e309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:33.394858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2cc66-fb77-4dde-ba03-891895b1e309 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:33.395141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2cc66-fb77-4dde-ba03-891895b1e309 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:33.395414 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2cc66-fb77-4dde-ba03-891895b1e309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:33.427856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:33.454685 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2cc66-fb77-4dde-ba03-891895b1e309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:33.456151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2cc66-fb77-4dde-ba03-891895b1e309 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:33.465588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1183/2342] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:38.098162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b7e91-4106-469c-9723-a5d071d1eee7 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.159227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b7e91-4106-469c-9723-a5d071d1eee7 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.163687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.164543 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.164826 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.165103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] PATH_INFO: `/v3/users/983258e456df4a2d950fc108cda3fb7a` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.166262 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=983258e456df4a2d950fc108cda3fb7a)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.168831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.212778 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '983258e456df4a2d950fc108cda3fb7a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.213414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '983258e456df4a2d950fc108cda3fb7a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.214013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '983258e456df4a2d950fc108cda3fb7a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.226281 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '983258e456df4a2d950fc108cda3fb7a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.233126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '983258e456df4a2d950fc108cda3fb7a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.245648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1160/2343] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:40:38 2022] DELETE /identity/v3/users/983258e456df4a2d950fc108cda3fb7a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:38.250219 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def90da-d52a-46d9-9b2a-7795e52d9658 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.250702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def90da-d52a-46d9-9b2a-7795e52d9658 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.250820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def90da-d52a-46d9-9b2a-7795e52d9658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.267895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-8def90da-d52a-46d9-9b2a-7795e52d9658 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:38.269023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8def90da-d52a-46d9-9b2a-7795e52d9658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:38.330113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1184/2344] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:38.340386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.341798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:38.355785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:38.401099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01a5a-f301-43f1-a573-222160369b6d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.405356 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a2ffa-8931-4a99-9a6d-92d6a257ba92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.406117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a2ffa-8931-4a99-9a6d-92d6a257ba92 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.406434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a2ffa-8931-4a99-9a6d-92d6a257ba92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.406717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a2ffa-8931-4a99-9a6d-92d6a257ba92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.416014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a2ffa-8931-4a99-9a6d-92d6a257ba92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.418005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a2ffa-8931-4a99-9a6d-92d6a257ba92 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.427720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1161/2345] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:38.716993 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def90da-d52a-46d9-9b2a-7795e52d9658 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.718458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8def90da-d52a-46d9-9b2a-7795e52d9658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:38.745858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def90da-d52a-46d9-9b2a-7795e52d9658 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.753552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.754318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.754612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.754944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] PATH_INFO: `/v3/projects/8e2b95f3a42745fa9328ae0e18f9169e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.756310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2b95f3a42745fa9328ae0e18f9169e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.759300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.810553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2b95f3a42745fa9328ae0e18f9169e', 'request_id': 'req-8c73950d-f819-446d-98da-1e3f4c0849fa'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.817827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2b95f3a42745fa9328ae0e18f9169e', 'request_id': 'req-8c73950d-f819-446d-98da-1e3f4c0849fa'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.823937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2b95f3a42745fa9328ae0e18f9169e', 'request_id': 'req-8c73950d-f819-446d-98da-1e3f4c0849fa'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.835048 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] The token cache is being invalidate because project 8e2b95f3a42745fa9328ae0e18f9169e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:40:38.835338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.835971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.837498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1185/2346] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:40:38 2022] DELETE /identity/v3/projects/8e2b95f3a42745fa9328ae0e18f9169e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:38.842009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a2ffa-8931-4a99-9a6d-92d6a257ba92 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:38.851586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a2ffa-8931-4a99-9a6d-92d6a257ba92 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:38.911671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:38.912538 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:38.912892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:38.913277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] PATH_INFO: `/v3/users/56943e9f964a4b73ab6f7d0cb392adde` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:38.914653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56943e9f964a4b73ab6f7d0cb392adde)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:38.916731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:38.964111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56943e9f964a4b73ab6f7d0cb392adde'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.965375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56943e9f964a4b73ab6f7d0cb392adde'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.965963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56943e9f964a4b73ab6f7d0cb392adde'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.978397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56943e9f964a4b73ab6f7d0cb392adde'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.985427 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-094973ac-1c57-43ba-9bbe-2e1ce6a02a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56943e9f964a4b73ab6f7d0cb392adde'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:38.999888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1162/2347] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:40:38 2022] DELETE /identity/v3/users/56943e9f964a4b73ab6f7d0cb392adde => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:40:39.263245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.264725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:39.279849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73950d-f819-446d-98da-1e3f4c0849fa admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.331087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:39.337738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.339032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.339356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.339844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] PATH_INFO: `/v3/projects/8edaaafb7f3042109e21c98c3f82620e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.341191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8edaaafb7f3042109e21c98c3f82620e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.343320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.389342 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8edaaafb7f3042109e21c98c3f82620e', 'request_id': 'req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:39.395650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8edaaafb7f3042109e21c98c3f82620e', 'request_id': 'req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:39.401312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8edaaafb7f3042109e21c98c3f82620e', 'request_id': 'req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:39.412317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] The token cache is being invalidate because project 8edaaafb7f3042109e21c98c3f82620e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:40:39.412608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:39.413235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aacb21fa-90a3-493a-bc52-aa6d6edc5de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:39.414800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1186/2348] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:40:39 2022] DELETE /identity/v3/projects/8edaaafb7f3042109e21c98c3f82620e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:39.419629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ddda-2230-4eb1-8290-02f3817d89a2 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.420167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ddda-2230-4eb1-8290-02f3817d89a2 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.420265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ddda-2230-4eb1-8290-02f3817d89a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.438005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-c0d7ddda-2230-4eb1-8290-02f3817d89a2 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:39.439241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c0d7ddda-2230-4eb1-8290-02f3817d89a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:39.468764 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:39.500306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1163/2349] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:39.508067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935fa72-ecaa-4f76-849a-16cc0c2f91c4 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.508385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935fa72-ecaa-4f76-849a-16cc0c2f91c4 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.508667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935fa72-ecaa-4f76-849a-16cc0c2f91c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.527190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d935fa72-ecaa-4f76-849a-16cc0c2f91c4 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:39.528392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d935fa72-ecaa-4f76-849a-16cc0c2f91c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:39.538495 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1187/2350] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:39.542677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7ddda-2230-4eb1-8290-02f3817d89a2 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.552516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7ddda-2230-4eb1-8290-02f3817d89a2 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.557100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf535c3-5506-4821-9eb4-6a2a65b0df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.557752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf535c3-5506-4821-9eb4-6a2a65b0df0d admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.558568 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf535c3-5506-4821-9eb4-6a2a65b0df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.558848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf535c3-5506-4821-9eb4-6a2a65b0df0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.559681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf535c3-5506-4821-9eb4-6a2a65b0df0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:39.559993 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf535c3-5506-4821-9eb4-6a2a65b0df0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.561588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf535c3-5506-4821-9eb4-6a2a65b0df0d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.573242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1164/2351] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:39.578252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935fa72-ecaa-4f76-849a-16cc0c2f91c4 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.587535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935fa72-ecaa-4f76-849a-16cc0c2f91c4 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.592202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166174e-20c9-44db-9a58-a4349a72fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.592855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166174e-20c9-44db-9a58-a4349a72fa69 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.593138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166174e-20c9-44db-9a58-a4349a72fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.593413 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166174e-20c9-44db-9a58-a4349a72fa69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.594109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166174e-20c9-44db-9a58-a4349a72fa69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.596056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166174e-20c9-44db-9a58-a4349a72fa69 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.621877 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1188/2352] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:40:39 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:39.626146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf535c3-5506-4821-9eb4-6a2a65b0df0d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.637016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf535c3-5506-4821-9eb4-6a2a65b0df0d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.691730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e070-4e4f-4fa4-b78e-e46fe9b35c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.692344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e070-4e4f-4fa4-b78e-e46fe9b35c28 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.692629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e070-4e4f-4fa4-b78e-e46fe9b35c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.692909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e070-4e4f-4fa4-b78e-e46fe9b35c28 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.693600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09e070-4e4f-4fa4-b78e-e46fe9b35c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.695542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09e070-4e4f-4fa4-b78e-e46fe9b35c28 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.715594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1165/2353] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:40:39 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:39.719627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166174e-20c9-44db-9a58-a4349a72fa69 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.730886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166174e-20c9-44db-9a58-a4349a72fa69 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.734888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d0d0-06d8-47b8-8e5a-6317726f63a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.735537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d0d0-06d8-47b8-8e5a-6317726f63a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.735818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d0d0-06d8-47b8-8e5a-6317726f63a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.736090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d0d0-06d8-47b8-8e5a-6317726f63a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.736815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801d0d0-06d8-47b8-8e5a-6317726f63a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.738434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801d0d0-06d8-47b8-8e5a-6317726f63a4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.751108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1189/2354] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:40:39.755011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e070-4e4f-4fa4-b78e-e46fe9b35c28 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.765018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e070-4e4f-4fa4-b78e-e46fe9b35c28 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.769653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a631ea-8e62-496b-9ddd-7c913596f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.770300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a631ea-8e62-496b-9ddd-7c913596f971 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.770619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a631ea-8e62-496b-9ddd-7c913596f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.770899 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a631ea-8e62-496b-9ddd-7c913596f971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.771624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a631ea-8e62-496b-9ddd-7c913596f971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.773213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a631ea-8e62-496b-9ddd-7c913596f971 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.783097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1166/2355] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:40:39.787202 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d0d0-06d8-47b8-8e5a-6317726f63a4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:39.798057 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d0d0-06d8-47b8-8e5a-6317726f63a4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:39.804373 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9fec-c2c4-4277-843e-a0405c406d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:39.805275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9fec-c2c4-4277-843e-a0405c406d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.805564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9fec-c2c4-4277-843e-a0405c406d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.805841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9fec-c2c4-4277-843e-a0405c406d57 admin admin] PATH_INFO: `/v3/projects/89cd3a1044cc4f2d895be464f7aa7514/users/e4e78a977e85484184fd44d12db30b75/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.824759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe9fec-c2c4-4277-843e-a0405c406d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89cd3a1044cc4f2d895be464f7aa7514, user_id=e4e78a977e85484184fd44d12db30b75, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:39.827544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe9fec-c2c4-4277-843e-a0405c406d57 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:39.848743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1190/2356] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:40:39 2022] PUT /identity/v3/projects/89cd3a1044cc4f2d895be464f7aa7514/users/e4e78a977e85484184fd44d12db30b75/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:39.860261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70d519-8502-4c8a-bcef-3992f27d87d6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:39.860553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70d519-8502-4c8a-bcef-3992f27d87d6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:39.860836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70d519-8502-4c8a-bcef-3992f27d87d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:39.887166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1c70d519-8502-4c8a-bcef-3992f27d87d6 None None] MFA Rules not processed for user `e4e78a977e85484184fd44d12db30b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:39.888395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1c70d519-8502-4c8a-bcef-3992f27d87d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:39.951340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1167/2357] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:39.955801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9fec-c2c4-4277-843e-a0405c406d57 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.016646 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9fec-c2c4-4277-843e-a0405c406d57 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.021319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a427b-ca53-4572-9316-49a251ed79bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.021973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a427b-ca53-4572-9316-49a251ed79bc admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.022258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a427b-ca53-4572-9316-49a251ed79bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.022561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a427b-ca53-4572-9316-49a251ed79bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.023246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a427b-ca53-4572-9316-49a251ed79bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.025151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a427b-ca53-4572-9316-49a251ed79bc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.054592 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1191/2358] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:40:39 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:40.055812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70d519-8502-4c8a-bcef-3992f27d87d6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.067683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70d519-8502-4c8a-bcef-3992f27d87d6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.096000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:40.132766 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df7959-2c6f-4c50-a5c5-6ed58e0774e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.133501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7959-2c6f-4c50-a5c5-6ed58e0774e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.133790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7959-2c6f-4c50-a5c5-6ed58e0774e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.134084 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7959-2c6f-4c50-a5c5-6ed58e0774e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.134871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df7959-2c6f-4c50-a5c5-6ed58e0774e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.136959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df7959-2c6f-4c50-a5c5-6ed58e0774e1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.158457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1168/2359] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:40:40 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:40.162232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a427b-ca53-4572-9316-49a251ed79bc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.173191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a427b-ca53-4572-9316-49a251ed79bc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.177968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924022d-122f-4a0b-93de-04be091c70b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.178667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924022d-122f-4a0b-93de-04be091c70b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.178953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924022d-122f-4a0b-93de-04be091c70b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.179231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924022d-122f-4a0b-93de-04be091c70b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.179962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924022d-122f-4a0b-93de-04be091c70b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.181603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924022d-122f-4a0b-93de-04be091c70b2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.183991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:40.199794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1192/2360] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:40:40.205188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df7959-2c6f-4c50-a5c5-6ed58e0774e1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.215979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df7959-2c6f-4c50-a5c5-6ed58e0774e1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.221005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7f232-1f85-4a6e-ae3d-a25b37af1f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.221887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7f232-1f85-4a6e-ae3d-a25b37af1f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.222174 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7f232-1f85-4a6e-ae3d-a25b37af1f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.222557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7f232-1f85-4a6e-ae3d-a25b37af1f25 admin admin] PATH_INFO: `/v3/projects/db87fecfd2934a969cc3a63b1ea65640/users/0ab99c91234d47169f40b709a7fffe34/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.237786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7f232-1f85-4a6e-ae3d-a25b37af1f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db87fecfd2934a969cc3a63b1ea65640, user_id=0ab99c91234d47169f40b709a7fffe34, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.240468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7f232-1f85-4a6e-ae3d-a25b37af1f25 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.253554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1169/2361] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:40:40 2022] PUT /identity/v3/projects/db87fecfd2934a969cc3a63b1ea65640/users/0ab99c91234d47169f40b709a7fffe34/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:40:40.257502 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924022d-122f-4a0b-93de-04be091c70b2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.267472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924022d-122f-4a0b-93de-04be091c70b2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.323283 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec302f-0e76-4556-965e-b70aa16523a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.324002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec302f-0e76-4556-965e-b70aa16523a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.324289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec302f-0e76-4556-965e-b70aa16523a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.324561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec302f-0e76-4556-965e-b70aa16523a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.325275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec302f-0e76-4556-965e-b70aa16523a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.326896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec302f-0e76-4556-965e-b70aa16523a2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.338676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1193/2362] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:40:40.343344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7f232-1f85-4a6e-ae3d-a25b37af1f25 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.353975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7f232-1f85-4a6e-ae3d-a25b37af1f25 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.359326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd8500-cdf2-48d7-8288-7ec2444e5f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.360197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd8500-cdf2-48d7-8288-7ec2444e5f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.360486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd8500-cdf2-48d7-8288-7ec2444e5f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.360767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd8500-cdf2-48d7-8288-7ec2444e5f19 admin admin] PATH_INFO: `/v3/projects/db87fecfd2934a969cc3a63b1ea65640/users/0ab99c91234d47169f40b709a7fffe34/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.362761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd8500-cdf2-48d7-8288-7ec2444e5f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db87fecfd2934a969cc3a63b1ea65640, user_id=0ab99c91234d47169f40b709a7fffe34, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.365408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd8500-cdf2-48d7-8288-7ec2444e5f19 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.375987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1170/2363] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:40:40 2022] PUT /identity/v3/projects/db87fecfd2934a969cc3a63b1ea65640/users/0ab99c91234d47169f40b709a7fffe34/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:40.385912 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585630e-a96c-4ae9-9f56-9fc819dcf777 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.386238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585630e-a96c-4ae9-9f56-9fc819dcf777 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.386550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585630e-a96c-4ae9-9f56-9fc819dcf777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.412729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b585630e-a96c-4ae9-9f56-9fc819dcf777 None None] MFA Rules not processed for user `0ab99c91234d47169f40b709a7fffe34`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:40.413939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b585630e-a96c-4ae9-9f56-9fc819dcf777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:40.482224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1194/2364] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:40.492861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd8500-cdf2-48d7-8288-7ec2444e5f19 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:40.494661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c6bd8500-cdf2-48d7-8288-7ec2444e5f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:40.552531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd8500-cdf2-48d7-8288-7ec2444e5f19 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:40.556129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd968047-c4f7-4cb0-a6b9-a6ed653542af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:40.556761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd968047-c4f7-4cb0-a6b9-a6ed653542af service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:40.557049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd968047-c4f7-4cb0-a6b9-a6ed653542af service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:40.557321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd968047-c4f7-4cb0-a6b9-a6ed653542af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:40.612983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd968047-c4f7-4cb0-a6b9-a6ed653542af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:40.614440 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd968047-c4f7-4cb0-a6b9-a6ed653542af service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:40.623486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1171/2365] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:44.752314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585630e-a96c-4ae9-9f56-9fc819dcf777 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:44.762604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585630e-a96c-4ae9-9f56-9fc819dcf777 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:44.766172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3b438-5b90-497b-b7e4-c329c750331f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:44.766849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3b438-5b90-497b-b7e4-c329c750331f service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:44.767134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3b438-5b90-497b-b7e4-c329c750331f service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:44.767418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3b438-5b90-497b-b7e4-c329c750331f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:44.776292 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3b438-5b90-497b-b7e4-c329c750331f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:44.777737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3b438-5b90-497b-b7e4-c329c750331f service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:44.787122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1195/2366] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:49.253194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe277de-793d-48a1-b8b6-c34640b169e7 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.253692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe277de-793d-48a1-b8b6-c34640b169e7 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.253789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe277de-793d-48a1-b8b6-c34640b169e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.270441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7fe277de-793d-48a1-b8b6-c34640b169e7 None None] MFA Rules not processed for user `6ca2454700fa46dbbfe0fe44bcbc266c`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:49.271645 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7fe277de-793d-48a1-b8b6-c34640b169e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:49.301694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:49.326633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1172/2367] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:49.722604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3b438-5b90-497b-b7e4-c329c750331f service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:49.785694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3b438-5b90-497b-b7e4-c329c750331f service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:49.790155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:49.791128 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.791407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.791678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] PATH_INFO: `/v3/users/e4e78a977e85484184fd44d12db30b75` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.792971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e78a977e85484184fd44d12db30b75)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:49.794870 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:49.805956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:49.858195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e78a977e85484184fd44d12db30b75'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:49.858893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e78a977e85484184fd44d12db30b75'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:49.867815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e78a977e85484184fd44d12db30b75'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:49.881180 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e78a977e85484184fd44d12db30b75'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:49.889158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e78a977e85484184fd44d12db30b75'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:49.895341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1196/2368] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:40:49 2022] DELETE /identity/v3/users/e4e78a977e85484184fd44d12db30b75 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:49.900296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb182fd-95fa-4b65-8e82-aca05846a8c8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:49.900614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb182fd-95fa-4b65-8e82-aca05846a8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:49.900896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb182fd-95fa-4b65-8e82-aca05846a8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:49.922665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dbb182fd-95fa-4b65-8e82-aca05846a8c8 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:49.922665 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dbb182fd-95fa-4b65-8e82-aca05846a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:49.992656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1173/2369] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:50.002724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.004268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:50.066062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d850d-7bd8-46fb-9c53-91b98a9db1ff admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.069767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac7cc-a3ff-43e1-b209-dd467ca5fe4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.070446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac7cc-a3ff-43e1-b209-dd467ca5fe4a service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.070738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac7cc-a3ff-43e1-b209-dd467ca5fe4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.071139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac7cc-a3ff-43e1-b209-dd467ca5fe4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.081147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edac7cc-a3ff-43e1-b209-dd467ca5fe4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.082612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edac7cc-a3ff-43e1-b209-dd467ca5fe4a service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.092909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1197/2370] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:50.377866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb182fd-95fa-4b65-8e82-aca05846a8c8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.379406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dbb182fd-95fa-4b65-8e82-aca05846a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:50.393341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb182fd-95fa-4b65-8e82-aca05846a8c8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.397999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.398891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.399178 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.399460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] PATH_INFO: `/v3/projects/89cd3a1044cc4f2d895be464f7aa7514` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.400639 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89cd3a1044cc4f2d895be464f7aa7514)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.403646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.454132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89cd3a1044cc4f2d895be464f7aa7514', 'request_id': 'req-09128ad4-c0ce-4ebb-9008-89ff764e7140'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:50.459837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89cd3a1044cc4f2d895be464f7aa7514', 'request_id': 'req-09128ad4-c0ce-4ebb-9008-89ff764e7140'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:50.466285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89cd3a1044cc4f2d895be464f7aa7514', 'request_id': 'req-09128ad4-c0ce-4ebb-9008-89ff764e7140'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:50.482326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] The token cache is being invalidate because project 89cd3a1044cc4f2d895be464f7aa7514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:40:50.482676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:50.483285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:50.484865 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1174/2371] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:40:50 2022] DELETE /identity/v3/projects/89cd3a1044cc4f2d895be464f7aa7514 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:50.489313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac7cc-a3ff-43e1-b209-dd467ca5fe4a service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.501772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac7cc-a3ff-43e1-b209-dd467ca5fe4a service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:50.563618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:50.564498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:50.564785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:50.565062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] PATH_INFO: `/v3/users/0ab99c91234d47169f40b709a7fffe34` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:50.566254 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab99c91234d47169f40b709a7fffe34)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:50.568705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:50.601663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:50.616778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab99c91234d47169f40b709a7fffe34'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:50.617682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab99c91234d47169f40b709a7fffe34'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:50.624875 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab99c91234d47169f40b709a7fffe34'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:50.636610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab99c91234d47169f40b709a7fffe34'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:50.643355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d195a9eb-624e-447d-be08-0ad868851a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab99c91234d47169f40b709a7fffe34'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:50.649131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1198/2372] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:40:50 2022] DELETE /identity/v3/users/0ab99c91234d47169f40b709a7fffe34 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:40:50.984872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:50.987497 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:51.009375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09128ad4-c0ce-4ebb-9008-89ff764e7140 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.093685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.094528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.094814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.095100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] PATH_INFO: `/v3/projects/db87fecfd2934a969cc3a63b1ea65640` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.096292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db87fecfd2934a969cc3a63b1ea65640)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.098210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.104822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:51.147888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db87fecfd2934a969cc3a63b1ea65640', 'request_id': 'req-7bca3524-9b67-4548-a25c-e5a543055729'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:51.154141 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db87fecfd2934a969cc3a63b1ea65640', 'request_id': 'req-7bca3524-9b67-4548-a25c-e5a543055729'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:51.160508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db87fecfd2934a969cc3a63b1ea65640', 'request_id': 'req-7bca3524-9b67-4548-a25c-e5a543055729'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:51.173321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] The token cache is being invalidate because project db87fecfd2934a969cc3a63b1ea65640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:40:51.173610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:51.174222 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7bca3524-9b67-4548-a25c-e5a543055729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:51.176000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1175/2373] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:40:50 2022] DELETE /identity/v3/projects/db87fecfd2934a969cc3a63b1ea65640 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:51.181638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ca009-f4de-4249-b531-024a8972d5b0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.182139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ca009-f4de-4249-b531-024a8972d5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.182243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ca009-f4de-4249-b531-024a8972d5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.202047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2f8ca009-f4de-4249-b531-024a8972d5b0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:51.203398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2f8ca009-f4de-4249-b531-024a8972d5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:51.265642 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1199/2374] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:40:51.274769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdcc82-dac1-4b47-b4dd-83f7ac47856e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.275056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdcc82-dac1-4b47-b4dd-83f7ac47856e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.275334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdcc82-dac1-4b47-b4dd-83f7ac47856e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.294046 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-45fdcc82-dac1-4b47-b4dd-83f7ac47856e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:51.295397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-45fdcc82-dac1-4b47-b4dd-83f7ac47856e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:51.303544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1176/2375] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:51.308859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ca009-f4de-4249-b531-024a8972d5b0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.318505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ca009-f4de-4249-b531-024a8972d5b0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.323187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca865e0-f3d9-4350-b9f1-8e04e9b65423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.324460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca865e0-f3d9-4350-b9f1-8e04e9b65423 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.324752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca865e0-f3d9-4350-b9f1-8e04e9b65423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.325032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca865e0-f3d9-4350-b9f1-8e04e9b65423 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.325756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca865e0-f3d9-4350-b9f1-8e04e9b65423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:51.326070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca865e0-f3d9-4350-b9f1-8e04e9b65423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.327729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca865e0-f3d9-4350-b9f1-8e04e9b65423 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.339322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1200/2376] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:51.343941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdcc82-dac1-4b47-b4dd-83f7ac47856e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.353624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdcc82-dac1-4b47-b4dd-83f7ac47856e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.358567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d2d6e-433e-4d15-b3ee-75f1bbdd16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.359216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d2d6e-433e-4d15-b3ee-75f1bbdd16fb admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.359502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d2d6e-433e-4d15-b3ee-75f1bbdd16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.359779 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d2d6e-433e-4d15-b3ee-75f1bbdd16fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.360482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d2d6e-433e-4d15-b3ee-75f1bbdd16fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.362395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d2d6e-433e-4d15-b3ee-75f1bbdd16fb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.394022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1177/2377] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:40:51 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:40:51.395142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca865e0-f3d9-4350-b9f1-8e04e9b65423 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.405713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca865e0-f3d9-4350-b9f1-8e04e9b65423 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.465644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674bf5-a8a6-4a43-9582-c721d4217078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.466308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674bf5-a8a6-4a43-9582-c721d4217078 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.466617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674bf5-a8a6-4a43-9582-c721d4217078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.466889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674bf5-a8a6-4a43-9582-c721d4217078 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.467571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69674bf5-a8a6-4a43-9582-c721d4217078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.469477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69674bf5-a8a6-4a43-9582-c721d4217078 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.489986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1201/2378] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:40:51 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:40:51.494263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d2d6e-433e-4d15-b3ee-75f1bbdd16fb admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.505163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d2d6e-433e-4d15-b3ee-75f1bbdd16fb admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.510472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73206d39-ec39-4e5b-846a-fd561a9552fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.511986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206d39-ec39-4e5b-846a-fd561a9552fa admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.512339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206d39-ec39-4e5b-846a-fd561a9552fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.512686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206d39-ec39-4e5b-846a-fd561a9552fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.513489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73206d39-ec39-4e5b-846a-fd561a9552fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.515190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73206d39-ec39-4e5b-846a-fd561a9552fa admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.526146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1178/2379] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:40:51.530265 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674bf5-a8a6-4a43-9582-c721d4217078 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.540771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674bf5-a8a6-4a43-9582-c721d4217078 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.545368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba719637-935e-49e2-b23b-5288a7dc409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.546021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719637-935e-49e2-b23b-5288a7dc409f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.546305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719637-935e-49e2-b23b-5288a7dc409f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.546615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719637-935e-49e2-b23b-5288a7dc409f admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.547334 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba719637-935e-49e2-b23b-5288a7dc409f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.548926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba719637-935e-49e2-b23b-5288a7dc409f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.559598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1202/2380] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:40:51.563856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73206d39-ec39-4e5b-846a-fd561a9552fa admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.575051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73206d39-ec39-4e5b-846a-fd561a9552fa admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.579790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d40b2b-b2f6-4360-a0a5-bc77f507048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.580706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d40b2b-b2f6-4360-a0a5-bc77f507048b admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.580992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d40b2b-b2f6-4360-a0a5-bc77f507048b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.581273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d40b2b-b2f6-4360-a0a5-bc77f507048b admin admin] PATH_INFO: `/v3/projects/b0f800b03e184596b592abc564088889/users/8edf2a68fca84221aba3e1601fa70142/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.596321 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d40b2b-b2f6-4360-a0a5-bc77f507048b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f800b03e184596b592abc564088889, user_id=8edf2a68fca84221aba3e1601fa70142, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.598959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d40b2b-b2f6-4360-a0a5-bc77f507048b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.613593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1179/2381] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:40:51 2022] PUT /identity/v3/projects/b0f800b03e184596b592abc564088889/users/8edf2a68fca84221aba3e1601fa70142/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:40:51.625855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cfb0f-17d0-443c-a66b-e0dfc544e669 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.626138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cfb0f-17d0-443c-a66b-e0dfc544e669 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.626455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cfb0f-17d0-443c-a66b-e0dfc544e669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.654236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:51.660971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f76cfb0f-17d0-443c-a66b-e0dfc544e669 None None] MFA Rules not processed for user `8edf2a68fca84221aba3e1601fa70142`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:51.662832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f76cfb0f-17d0-443c-a66b-e0dfc544e669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:51.752914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1203/2382] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:51.754117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d40b2b-b2f6-4360-a0a5-bc77f507048b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:51.756878 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f0d40b2b-b2f6-4360-a0a5-bc77f507048b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:51.825060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d40b2b-b2f6-4360-a0a5-bc77f507048b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:51.828728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa802feb-9436-449f-80fc-9a53a4c0861c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:51.829439 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa802feb-9436-449f-80fc-9a53a4c0861c service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:51.829808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa802feb-9436-449f-80fc-9a53a4c0861c service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:51.830152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa802feb-9436-449f-80fc-9a53a4c0861c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:51.839080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa802feb-9436-449f-80fc-9a53a4c0861c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:51.840638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa802feb-9436-449f-80fc-9a53a4c0861c service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:51.850204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1180/2383] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:57.188703 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cfb0f-17d0-443c-a66b-e0dfc544e669 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.250483 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cfb0f-17d0-443c-a66b-e0dfc544e669 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.254747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.255609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.255894 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.256167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] PATH_INFO: `/v3/users/8edf2a68fca84221aba3e1601fa70142` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.257331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edf2a68fca84221aba3e1601fa70142)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.259318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.311396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edf2a68fca84221aba3e1601fa70142'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:57.312426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edf2a68fca84221aba3e1601fa70142'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:57.321281 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edf2a68fca84221aba3e1601fa70142'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:57.337683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edf2a68fca84221aba3e1601fa70142'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:57.346582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edf2a68fca84221aba3e1601fa70142'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:57.353615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1204/2384] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:40:57 2022] DELETE /identity/v3/users/8edf2a68fca84221aba3e1601fa70142 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:57.358798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a67a51-1f2b-4d08-af54-53ea29719c08 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.359354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a67a51-1f2b-4d08-af54-53ea29719c08 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.359354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a67a51-1f2b-4d08-af54-53ea29719c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.376238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b7a67a51-1f2b-4d08-af54-53ea29719c08 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:57.377469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b7a67a51-1f2b-4d08-af54-53ea29719c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:57.407622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:57.441979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1181/2385] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:57.451485 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.452872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:57.479163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:57.511907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73957063-6714-49dc-880f-738b9f3da71c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.515418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bccdb4-a8a4-4bbf-8361-1f9692ac2f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.516060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bccdb4-a8a4-4bbf-8361-1f9692ac2f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.516341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bccdb4-a8a4-4bbf-8361-1f9692ac2f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.516619 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bccdb4-a8a4-4bbf-8361-1f9692ac2f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.525432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bccdb4-a8a4-4bbf-8361-1f9692ac2f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.527393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bccdb4-a8a4-4bbf-8361-1f9692ac2f47 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.536609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1205/2386] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:40:57.801753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a67a51-1f2b-4d08-af54-53ea29719c08 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:57.803304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b7a67a51-1f2b-4d08-af54-53ea29719c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:57.816305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a67a51-1f2b-4d08-af54-53ea29719c08 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:57.821059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:57.821907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.822183 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.822569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] PATH_INFO: `/v3/projects/b0f800b03e184596b592abc564088889` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.824245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f800b03e184596b592abc564088889)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:57.826140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:57.877921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f800b03e184596b592abc564088889', 'request_id': 'req-72a2b092-d31c-482e-8255-59898b1a71cb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:57.885234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f800b03e184596b592abc564088889', 'request_id': 'req-72a2b092-d31c-482e-8255-59898b1a71cb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:57.892073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f800b03e184596b592abc564088889', 'request_id': 'req-72a2b092-d31c-482e-8255-59898b1a71cb'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:57.904582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] The token cache is being invalidate because project b0f800b03e184596b592abc564088889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:40:57.904879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:57.905493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-72a2b092-d31c-482e-8255-59898b1a71cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:40:57.907055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1182/2387] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:40:57 2022] DELETE /identity/v3/projects/b0f800b03e184596b592abc564088889 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:57.912833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ff481-769e-40a9-8276-194556f2634d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.913121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ff481-769e-40a9-8276-194556f2634d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.913398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ff481-769e-40a9-8276-194556f2634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:57.931531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2e4ff481-769e-40a9-8276-194556f2634d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:57.932750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2e4ff481-769e-40a9-8276-194556f2634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:57.990201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1206/2388] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:57.998334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd7989-3f85-4452-9f62-5bcc84d967f5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:57.998648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd7989-3f85-4452-9f62-5bcc84d967f5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:57.998928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd7989-3f85-4452-9f62-5bcc84d967f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.017094 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-2bfd7989-3f85-4452-9f62-5bcc84d967f5 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:58.018279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2bfd7989-3f85-4452-9f62-5bcc84d967f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:58.025970 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1183/2389] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:58.030544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ff481-769e-40a9-8276-194556f2634d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.040099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ff481-769e-40a9-8276-194556f2634d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.044830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a5c6-c03f-44e4-b8df-97ce0bc5ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.045419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a5c6-c03f-44e4-b8df-97ce0bc5ba2d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.045703 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a5c6-c03f-44e4-b8df-97ce0bc5ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.045981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9a5c6-c03f-44e4-b8df-97ce0bc5ba2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.046749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a5c6-c03f-44e4-b8df-97ce0bc5ba2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:40:58.047054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a5c6-c03f-44e4-b8df-97ce0bc5ba2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.048640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9a5c6-c03f-44e4-b8df-97ce0bc5ba2d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.061096 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1207/2390] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:40:58.065542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd7989-3f85-4452-9f62-5bcc84d967f5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.075374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd7989-3f85-4452-9f62-5bcc84d967f5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.080149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9604583-e6d8-42d2-bbd6-e39bbc49715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.080798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9604583-e6d8-42d2-bbd6-e39bbc49715e admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.081089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9604583-e6d8-42d2-bbd6-e39bbc49715e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.081371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9604583-e6d8-42d2-bbd6-e39bbc49715e admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.082062 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9604583-e6d8-42d2-bbd6-e39bbc49715e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.083990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9604583-e6d8-42d2-bbd6-e39bbc49715e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.123075 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1184/2391] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:40:58 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:58.124347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a5c6-c03f-44e4-b8df-97ce0bc5ba2d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.134212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9a5c6-c03f-44e4-b8df-97ce0bc5ba2d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.194741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c60af-1a30-4ee2-a1fc-54eae57850a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.195464 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c60af-1a30-4ee2-a1fc-54eae57850a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.195882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c60af-1a30-4ee2-a1fc-54eae57850a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.196126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c60af-1a30-4ee2-a1fc-54eae57850a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.196824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c60af-1a30-4ee2-a1fc-54eae57850a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.199383 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c60af-1a30-4ee2-a1fc-54eae57850a8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.221805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1208/2392] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:40:58 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:40:58.226583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9604583-e6d8-42d2-bbd6-e39bbc49715e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.237285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9604583-e6d8-42d2-bbd6-e39bbc49715e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.242671 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aee6be-211d-42c2-9faf-4a50e99efb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.243325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aee6be-211d-42c2-9faf-4a50e99efb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.243609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aee6be-211d-42c2-9faf-4a50e99efb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.243888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aee6be-211d-42c2-9faf-4a50e99efb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.244611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aee6be-211d-42c2-9faf-4a50e99efb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.246935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aee6be-211d-42c2-9faf-4a50e99efb53 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.257805 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1185/2393] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:40:58.262623 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c60af-1a30-4ee2-a1fc-54eae57850a8 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.272824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c60af-1a30-4ee2-a1fc-54eae57850a8 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.277519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ff018-89ae-404e-81c2-0c5ff8c30836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.278179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ff018-89ae-404e-81c2-0c5ff8c30836 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.278506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ff018-89ae-404e-81c2-0c5ff8c30836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.278942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ff018-89ae-404e-81c2-0c5ff8c30836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.279707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ff018-89ae-404e-81c2-0c5ff8c30836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.281328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ff018-89ae-404e-81c2-0c5ff8c30836 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.292063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1209/2394] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:40:58.296622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aee6be-211d-42c2-9faf-4a50e99efb53 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.307399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aee6be-211d-42c2-9faf-4a50e99efb53 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.312913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378e53-73a9-4eea-b3c0-50fa95c65339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.313802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378e53-73a9-4eea-b3c0-50fa95c65339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.314087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378e53-73a9-4eea-b3c0-50fa95c65339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.314382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378e53-73a9-4eea-b3c0-50fa95c65339 admin admin] PATH_INFO: `/v3/projects/92287275f57f4308b01708cead0c892b/users/6607aabe951b4e10b0f67145d996df2d/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.330173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b378e53-73a9-4eea-b3c0-50fa95c65339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92287275f57f4308b01708cead0c892b, user_id=6607aabe951b4e10b0f67145d996df2d, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.332858 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b378e53-73a9-4eea-b3c0-50fa95c65339 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.346786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1186/2395] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:40:58 2022] PUT /identity/v3/projects/92287275f57f4308b01708cead0c892b/users/6607aabe951b4e10b0f67145d996df2d/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:40:58.358116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833653-432f-47fc-a060-0c1747618d1a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.358456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833653-432f-47fc-a060-0c1747618d1a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.358744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833653-432f-47fc-a060-0c1747618d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.385676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-42833653-432f-47fc-a060-0c1747618d1a None None] MFA Rules not processed for user `6607aabe951b4e10b0f67145d996df2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:40:58.387505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-42833653-432f-47fc-a060-0c1747618d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:58.405518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:58.452644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1210/2396] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:40:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:40:58.463712 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378e53-73a9-4eea-b3c0-50fa95c65339 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:40:58.465512 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-2b378e53-73a9-4eea-b3c0-50fa95c65339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:40:58.522132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378e53-73a9-4eea-b3c0-50fa95c65339 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:40:58.525839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e1238-70a5-47ec-a9a4-570a293eb0e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:40:58.526519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e1238-70a5-47ec-a9a4-570a293eb0e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:40:58.526809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e1238-70a5-47ec-a9a4-570a293eb0e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:40:58.527086 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e1238-70a5-47ec-a9a4-570a293eb0e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:40:58.533261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:40:58.535767 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e1238-70a5-47ec-a9a4-570a293eb0e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:40:58.537701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e1238-70a5-47ec-a9a4-570a293eb0e4 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:40:58.549079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1187/2397] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:40:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:41:01.094442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42833653-432f-47fc-a060-0c1747618d1a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:01.156786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42833653-432f-47fc-a060-0c1747618d1a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.161266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.162118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.162424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.162706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] PATH_INFO: `/v3/users/6607aabe951b4e10b0f67145d996df2d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.163859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6607aabe951b4e10b0f67145d996df2d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.165770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:01.210424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6607aabe951b4e10b0f67145d996df2d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:01.211097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6607aabe951b4e10b0f67145d996df2d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:01.219161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6607aabe951b4e10b0f67145d996df2d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:01.230948 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6607aabe951b4e10b0f67145d996df2d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:01.237712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6607aabe951b4e10b0f67145d996df2d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:01.244123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1211/2398] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:41:01 2022] DELETE /identity/v3/users/6607aabe951b4e10b0f67145d996df2d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:41:01.249170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cdfe0-0d59-44ff-8d6b-940aeab4fc8c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.249616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cdfe0-0d59-44ff-8d6b-940aeab4fc8c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.249722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cdfe0-0d59-44ff-8d6b-940aeab4fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.268312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ef8cdfe0-0d59-44ff-8d6b-940aeab4fc8c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:01.269471 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ef8cdfe0-0d59-44ff-8d6b-940aeab4fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:01.331189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1188/2399] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:01.340741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:01.342133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:01.385986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:01.403530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c5db4-2937-4157-a4bd-0a3207d3bee3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.407171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf0fba-d6da-48e4-8903-5107ee863662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.407810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf0fba-d6da-48e4-8903-5107ee863662 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.408120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf0fba-d6da-48e4-8903-5107ee863662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.408396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf0fba-d6da-48e4-8903-5107ee863662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.417763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf0fba-d6da-48e4-8903-5107ee863662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.419206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf0fba-d6da-48e4-8903-5107ee863662 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:01.428553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1212/2400] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:41:01.699713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cdfe0-0d59-44ff-8d6b-940aeab4fc8c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:01.701329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ef8cdfe0-0d59-44ff-8d6b-940aeab4fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:01.718794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cdfe0-0d59-44ff-8d6b-940aeab4fc8c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.730551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.731564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.732469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.732755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] PATH_INFO: `/v3/projects/92287275f57f4308b01708cead0c892b` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.733984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92287275f57f4308b01708cead0c892b)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.735973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:01.790879 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92287275f57f4308b01708cead0c892b', 'request_id': 'req-f43b1099-dd85-41b1-8527-78f6591b743a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:01.797837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92287275f57f4308b01708cead0c892b', 'request_id': 'req-f43b1099-dd85-41b1-8527-78f6591b743a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:01.804641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92287275f57f4308b01708cead0c892b', 'request_id': 'req-f43b1099-dd85-41b1-8527-78f6591b743a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:01.818646 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] The token cache is being invalidate because project 92287275f57f4308b01708cead0c892b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:41:01.818937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:01.819566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f43b1099-dd85-41b1-8527-78f6591b743a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:01.821502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1189/2401] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:41:01 2022] DELETE /identity/v3/projects/92287275f57f4308b01708cead0c892b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:01.826213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a244c-9f40-4c4e-92cc-6ceeb0608dce None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.826532 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a244c-9f40-4c4e-92cc-6ceeb0608dce None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.826816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a244c-9f40-4c4e-92cc-6ceeb0608dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.844864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ca3a244c-9f40-4c4e-92cc-6ceeb0608dce None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:01.846092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ca3a244c-9f40-4c4e-92cc-6ceeb0608dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:01.924278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1213/2402] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:01.925976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e413-c75e-4a4f-8b5d-24466f1f0c92 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.926268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e413-c75e-4a4f-8b5d-24466f1f0c92 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.926596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e413-c75e-4a4f-8b5d-24466f1f0c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.956102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d248e413-c75e-4a4f-8b5d-24466f1f0c92 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:01.957329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d248e413-c75e-4a4f-8b5d-24466f1f0c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:01.966521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1190/2403] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:01.970662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a244c-9f40-4c4e-92cc-6ceeb0608dce None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:01.980974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a244c-9f40-4c4e-92cc-6ceeb0608dce None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:01.985553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4096fa-5fd7-4fbd-997a-5f34f2148b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:01.986208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4096fa-5fd7-4fbd-997a-5f34f2148b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:01.987907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4096fa-5fd7-4fbd-997a-5f34f2148b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:01.987907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4096fa-5fd7-4fbd-997a-5f34f2148b26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:01.988121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4096fa-5fd7-4fbd-997a-5f34f2148b26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:41:01.988411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4096fa-5fd7-4fbd-997a-5f34f2148b26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:01.990014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4096fa-5fd7-4fbd-997a-5f34f2148b26 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.002176 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1214/2404] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:41:02.006466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248e413-c75e-4a4f-8b5d-24466f1f0c92 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.015866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248e413-c75e-4a4f-8b5d-24466f1f0c92 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.021068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce34d7-120a-4e5b-9aaf-a876fedc63d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.021721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce34d7-120a-4e5b-9aaf-a876fedc63d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.022001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce34d7-120a-4e5b-9aaf-a876fedc63d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.022277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce34d7-120a-4e5b-9aaf-a876fedc63d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.023022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce34d7-120a-4e5b-9aaf-a876fedc63d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.024898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce34d7-120a-4e5b-9aaf-a876fedc63d4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.051294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1191/2405] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:41:02 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:41:02.055084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4096fa-5fd7-4fbd-997a-5f34f2148b26 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.065318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4096fa-5fd7-4fbd-997a-5f34f2148b26 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.122653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f679a08-d560-4d08-930b-01d450d95743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.123329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679a08-d560-4d08-930b-01d450d95743 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.123597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679a08-d560-4d08-930b-01d450d95743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.123871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679a08-d560-4d08-930b-01d450d95743 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.124555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f679a08-d560-4d08-930b-01d450d95743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.126497 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f679a08-d560-4d08-930b-01d450d95743 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.145135 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1215/2406] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:41:02 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:41:02.149111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce34d7-120a-4e5b-9aaf-a876fedc63d4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.160405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce34d7-120a-4e5b-9aaf-a876fedc63d4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.165156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aa47a-71eb-42a6-8af2-68cd547f8398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.165815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aa47a-71eb-42a6-8af2-68cd547f8398 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.166100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aa47a-71eb-42a6-8af2-68cd547f8398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.166407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aa47a-71eb-42a6-8af2-68cd547f8398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.167133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190aa47a-71eb-42a6-8af2-68cd547f8398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.169284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190aa47a-71eb-42a6-8af2-68cd547f8398 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.179708 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1192/2407] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:41:02.183747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f679a08-d560-4d08-930b-01d450d95743 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.193888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f679a08-d560-4d08-930b-01d450d95743 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.199148 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9ab2-7057-4cf7-967c-02156be0722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.199808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9ab2-7057-4cf7-967c-02156be0722e admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.200116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9ab2-7057-4cf7-967c-02156be0722e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.200394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9ab2-7057-4cf7-967c-02156be0722e admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.201124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9ab2-7057-4cf7-967c-02156be0722e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.202751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9ab2-7057-4cf7-967c-02156be0722e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.212816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1216/2408] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:41:02.217547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aa47a-71eb-42a6-8af2-68cd547f8398 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.228128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aa47a-71eb-42a6-8af2-68cd547f8398 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.232966 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42176319-413b-4566-a4d8-dde2cd12cdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.233847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42176319-413b-4566-a4d8-dde2cd12cdc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.234133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42176319-413b-4566-a4d8-dde2cd12cdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.234456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42176319-413b-4566-a4d8-dde2cd12cdc7 admin admin] PATH_INFO: `/v3/projects/edc9ba84754f47b4ba37dc36e91419ce/users/68b9a3e5dad0460dbd6bbee53569129d/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.249623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42176319-413b-4566-a4d8-dde2cd12cdc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc9ba84754f47b4ba37dc36e91419ce, user_id=68b9a3e5dad0460dbd6bbee53569129d, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.252331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42176319-413b-4566-a4d8-dde2cd12cdc7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.275829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1193/2409] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:41:02 2022] PUT /identity/v3/projects/edc9ba84754f47b4ba37dc36e91419ce/users/68b9a3e5dad0460dbd6bbee53569129d/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:02.277998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99354e2c-8457-4480-b677-165d86d2a589 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.278288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99354e2c-8457-4480-b677-165d86d2a589 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.278594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99354e2c-8457-4480-b677-165d86d2a589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.305628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-99354e2c-8457-4480-b677-165d86d2a589 None None] MFA Rules not processed for user `68b9a3e5dad0460dbd6bbee53569129d`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:02.306843 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-99354e2c-8457-4480-b677-165d86d2a589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:02.359250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:02.389871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1217/2410] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:02.400635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42176319-413b-4566-a4d8-dde2cd12cdc7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:02.403049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-42176319-413b-4566-a4d8-dde2cd12cdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:02.422498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:02.466479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42176319-413b-4566-a4d8-dde2cd12cdc7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:02.470158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309f108-3e3a-415e-98ba-669c1955a0ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:02.470843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f108-3e3a-415e-98ba-669c1955a0ce service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:02.471127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f108-3e3a-415e-98ba-669c1955a0ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:02.471406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f108-3e3a-415e-98ba-669c1955a0ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:02.480055 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309f108-3e3a-415e-98ba-669c1955a0ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:02.481541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309f108-3e3a-415e-98ba-669c1955a0ce service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:02.490452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1194/2411] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:41:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:41:03.842080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20ced9-a272-40d9-8433-a0b7dec2e734 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:03.842603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20ced9-a272-40d9-8433-a0b7dec2e734 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:03.842706 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20ced9-a272-40d9-8433-a0b7dec2e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:03.860902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ce20ced9-a272-40d9-8433-a0b7dec2e734 None None] MFA Rules not processed for user `68b9a3e5dad0460dbd6bbee53569129d`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:03.862117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ce20ced9-a272-40d9-8433-a0b7dec2e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:03.869749 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1218/2412] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:12.486485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=19 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:13.854849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=13 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:18.666336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36756bcd-0bb5-4cb4-8343-7fcb1c7b2b37 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.667061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36756bcd-0bb5-4cb4-8343-7fcb1c7b2b37 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.667061 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36756bcd-0bb5-4cb4-8343-7fcb1c7b2b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.684399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-36756bcd-0bb5-4cb4-8343-7fcb1c7b2b37 None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:18.686188 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-36756bcd-0bb5-4cb4-8343-7fcb1c7b2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:18.743219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1195/2413] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:41:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:18.761851 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20ced9-a272-40d9-8433-a0b7dec2e734 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:18.763701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ce20ced9-a272-40d9-8433-a0b7dec2e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:18.796793 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36756bcd-0bb5-4cb4-8343-7fcb1c7b2b37 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:18.798041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-36756bcd-0bb5-4cb4-8343-7fcb1c7b2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:18.833645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20ced9-a272-40d9-8433-a0b7dec2e734 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:18.838253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02bc68-7c32-4419-b702-c2b4be3e4fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.838544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02bc68-7c32-4419-b702-c2b4be3e4fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.838711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02bc68-7c32-4419-b702-c2b4be3e4fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.838992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02bc68-7c32-4419-b702-c2b4be3e4fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.840807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0f02bc68-7c32-4419-b702-c2b4be3e4fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:18.877560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36756bcd-0bb5-4cb4-8343-7fcb1c7b2b37 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:18.883768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4866a9-14be-47a5-834e-e556822f1768 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:18.884476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4866a9-14be-47a5-834e-e556822f1768 service swift] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:18.884762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4866a9-14be-47a5-834e-e556822f1768 service swift] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:18.885094 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4866a9-14be-47a5-834e-e556822f1768 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:18.895437 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4866a9-14be-47a5-834e-e556822f1768 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.897029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4866a9-14be-47a5-834e-e556822f1768 service swift] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.905670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1196/2414] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:41:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 10:41:18.911410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02bc68-7c32-4419-b702-c2b4be3e4fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:18.912932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02bc68-7c32-4419-b702-c2b4be3e4fb7 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:18.945892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1219/2415] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:41:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:41:20.825939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7722e-8c3b-4c64-90e6-6e8fc917a759 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.826495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7722e-8c3b-4c64-90e6-6e8fc917a759 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.826647 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7722e-8c3b-4c64-90e6-6e8fc917a759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.848036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f7b7722e-8c3b-4c64-90e6-6e8fc917a759 None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:20.849506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f7b7722e-8c3b-4c64-90e6-6e8fc917a759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:20.864337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1197/2416] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:41:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:20.883964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02bc68-7c32-4419-b702-c2b4be3e4fb7 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:20.900551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02bc68-7c32-4419-b702-c2b4be3e4fb7 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:20.916352 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65ffe6-43da-4830-a038-7d4c8072aba6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:20.917033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65ffe6-43da-4830-a038-7d4c8072aba6 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:20.917321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65ffe6-43da-4830-a038-7d4c8072aba6 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:20.917601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65ffe6-43da-4830-a038-7d4c8072aba6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:20.927968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65ffe6-43da-4830-a038-7d4c8072aba6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:20.929612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65ffe6-43da-4830-a038-7d4c8072aba6 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:20.939594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1220/2417] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:41:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:41:21.662308 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ee58a-e281-40a0-b3fe-690ba02b2ffa None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:21.662627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ee58a-e281-40a0-b3fe-690ba02b2ffa None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:21.662910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ee58a-e281-40a0-b3fe-690ba02b2ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:21.687998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-681ee58a-e281-40a0-b3fe-690ba02b2ffa None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:21.690588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-681ee58a-e281-40a0-b3fe-690ba02b2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:21.706224 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1198/2418] 10.222.0.44 () {58 vars in 967 bytes} [Fri Jun 24 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:21.734467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65ffe6-43da-4830-a038-7d4c8072aba6 service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:21.746700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65ffe6-43da-4830-a038-7d4c8072aba6 service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:21.767916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178583b-7f14-41ab-9737-fb2aeacf0472 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:21.769030 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178583b-7f14-41ab-9737-fb2aeacf0472 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:21.769377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178583b-7f14-41ab-9737-fb2aeacf0472 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:21.769727 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178583b-7f14-41ab-9737-fb2aeacf0472 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:21.795990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178583b-7f14-41ab-9737-fb2aeacf0472 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:21.799638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178583b-7f14-41ab-9737-fb2aeacf0472 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:21.812264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1221/2419] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:41:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:41:22.152397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea0b96-bbdc-4132-88b8-62204339a189 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:22.152948 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea0b96-bbdc-4132-88b8-62204339a189 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:22.152948 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea0b96-bbdc-4132-88b8-62204339a189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:22.175352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-09ea0b96-bbdc-4132-88b8-62204339a189 None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:22.176703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-09ea0b96-bbdc-4132-88b8-62204339a189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:22.194414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1199/2420] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:41:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:22.198418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178583b-7f14-41ab-9737-fb2aeacf0472 service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:22.210480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178583b-7f14-41ab-9737-fb2aeacf0472 service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:22.216584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519135c9-3736-4f19-8afa-59340b1fe434 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:22.217355 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519135c9-3736-4f19-8afa-59340b1fe434 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:22.217699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519135c9-3736-4f19-8afa-59340b1fe434 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:22.218042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519135c9-3736-4f19-8afa-59340b1fe434 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:22.228183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519135c9-3736-4f19-8afa-59340b1fe434 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:22.229939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519135c9-3736-4f19-8afa-59340b1fe434 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:22.240418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1222/2421] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:41:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 10:41:22.821303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e1554-2aea-406b-93d1-c42fae77929d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:22.821603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e1554-2aea-406b-93d1-c42fae77929d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:22.821891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e1554-2aea-406b-93d1-c42fae77929d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:22.853063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-401e1554-2aea-406b-93d1-c42fae77929d None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:22.855003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-401e1554-2aea-406b-93d1-c42fae77929d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:22.868248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1200/2422] 10.222.0.44 () {58 vars in 967 bytes} [Fri Jun 24 10:41:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:22.900318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519135c9-3736-4f19-8afa-59340b1fe434 service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:22.918235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519135c9-3736-4f19-8afa-59340b1fe434 service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:22.933471 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc9a5f-47d3-44d9-952c-2b4e14662e77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:22.934432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc9a5f-47d3-44d9-952c-2b4e14662e77 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:22.935702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc9a5f-47d3-44d9-952c-2b4e14662e77 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:22.936464 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc9a5f-47d3-44d9-952c-2b4e14662e77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:22.949189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc9a5f-47d3-44d9-952c-2b4e14662e77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:22.952687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc9a5f-47d3-44d9-952c-2b4e14662e77 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:22.968416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1223/2423] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:41:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:41:24.518752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e1554-2aea-406b-93d1-c42fae77929d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:24.520300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-401e1554-2aea-406b-93d1-c42fae77929d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:24.536520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e1554-2aea-406b-93d1-c42fae77929d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:24.541741 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68eb809-eea6-43bc-aa1d-558f3b415849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:24.542564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eb809-eea6-43bc-aa1d-558f3b415849 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:24.542886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eb809-eea6-43bc-aa1d-558f3b415849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:24.543183 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eb809-eea6-43bc-aa1d-558f3b415849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:24.546310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b68eb809-eea6-43bc-aa1d-558f3b415849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:24.630456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68eb809-eea6-43bc-aa1d-558f3b415849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:24.632978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68eb809-eea6-43bc-aa1d-558f3b415849 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:24.648603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1201/2424] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:41:25.502427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc9a5f-47d3-44d9-952c-2b4e14662e77 service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:25.518073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc9a5f-47d3-44d9-952c-2b4e14662e77 service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:25.531571 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:25.532589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.532998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.533455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] PATH_INFO: `/v3/users/68b9a3e5dad0460dbd6bbee53569129d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.535262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b9a3e5dad0460dbd6bbee53569129d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:25.537462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:25.635024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b9a3e5dad0460dbd6bbee53569129d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:25.635953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b9a3e5dad0460dbd6bbee53569129d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:25.649196 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b9a3e5dad0460dbd6bbee53569129d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:25.662990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:25.698773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b9a3e5dad0460dbd6bbee53569129d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:25.709620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b9a3e5dad0460dbd6bbee53569129d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:25.718480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1224/2425] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:41:25 2022] DELETE /identity/v3/users/68b9a3e5dad0460dbd6bbee53569129d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:25.723039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f09b9-83ae-4d73-a2b2-e5cda3c85284 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:25.723546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f09b9-83ae-4d73-a2b2-e5cda3c85284 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:25.723641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f09b9-83ae-4d73-a2b2-e5cda3c85284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:25.732818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:25.771608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-246f09b9-83ae-4d73-a2b2-e5cda3c85284 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:25.774070 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-246f09b9-83ae-4d73-a2b2-e5cda3c85284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:25.944525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1202/2426] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:25.955320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:25.956814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:26.046112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76d4d9-4e14-4ae0-a7cf-413e1e554645 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:26.050317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbedde9-e59b-40f1-b9e4-b7ec4400104e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:26.051012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbedde9-e59b-40f1-b9e4-b7ec4400104e service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:26.051295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbedde9-e59b-40f1-b9e4-b7ec4400104e service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:26.051570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbedde9-e59b-40f1-b9e4-b7ec4400104e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:26.065084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbedde9-e59b-40f1-b9e4-b7ec4400104e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:26.066581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbedde9-e59b-40f1-b9e4-b7ec4400104e service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:26.080555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1225/2427] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:41:26.323457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f09b9-83ae-4d73-a2b2-e5cda3c85284 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:26.324967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-246f09b9-83ae-4d73-a2b2-e5cda3c85284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:26.343476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f09b9-83ae-4d73-a2b2-e5cda3c85284 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:26.359090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:26.360157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:26.360555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:26.360907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] PATH_INFO: `/v3/projects/edc9ba84754f47b4ba37dc36e91419ce` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:26.363063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc9ba84754f47b4ba37dc36e91419ce)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:26.366726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:26.450306 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc9ba84754f47b4ba37dc36e91419ce', 'request_id': 'req-fb6d939e-4da4-4852-88ad-1b4204ee8393'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:26.462687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc9ba84754f47b4ba37dc36e91419ce', 'request_id': 'req-fb6d939e-4da4-4852-88ad-1b4204ee8393'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:26.474442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc9ba84754f47b4ba37dc36e91419ce', 'request_id': 'req-fb6d939e-4da4-4852-88ad-1b4204ee8393'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:26.500099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] The token cache is being invalidate because project edc9ba84754f47b4ba37dc36e91419ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:41:26.500713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:26.501377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:26.503383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1203/2428] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:41:26 2022] DELETE /identity/v3/projects/edc9ba84754f47b4ba37dc36e91419ce => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:32.700813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbedde9-e59b-40f1-b9e4-b7ec4400104e service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:32.702253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9dbedde9-e59b-40f1-b9e4-b7ec4400104e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:32.715137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbedde9-e59b-40f1-b9e4-b7ec4400104e service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:32.772537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:32.773396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:32.773674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:32.773947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] PATH_INFO: `/v3/users/9046f8fd0c484c2990a32f91176f1764` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:32.775145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9046f8fd0c484c2990a32f91176f1764)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:32.777089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:32.822096 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9046f8fd0c484c2990a32f91176f1764'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:32.822666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9046f8fd0c484c2990a32f91176f1764'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:32.830319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9046f8fd0c484c2990a32f91176f1764'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:32.842210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9046f8fd0c484c2990a32f91176f1764'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:32.847556 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:32.849684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9046f8fd0c484c2990a32f91176f1764'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:32.857404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1226/2429] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:41:32 2022] DELETE /identity/v3/users/9046f8fd0c484c2990a32f91176f1764 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:33.027265 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:33.028777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:33.042386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d939e-4da4-4852-88ad-1b4204ee8393 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:33.099752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:33.100533 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:33.100816 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:33.101092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] PATH_INFO: `/v3/projects/a3f83cae6ac14066855acb39b99294e7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:33.102251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f83cae6ac14066855acb39b99294e7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:33.104176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:33.135644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:33.153162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f83cae6ac14066855acb39b99294e7', 'request_id': 'req-8ee15c8f-60f6-4bc7-a493-26530b546274'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.159339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f83cae6ac14066855acb39b99294e7', 'request_id': 'req-8ee15c8f-60f6-4bc7-a493-26530b546274'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.165509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f83cae6ac14066855acb39b99294e7', 'request_id': 'req-8ee15c8f-60f6-4bc7-a493-26530b546274'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.178420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] The token cache is being invalidate because project a3f83cae6ac14066855acb39b99294e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:41:33.178717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.179351 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.180919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1204/2430] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:41:33 2022] DELETE /identity/v3/projects/a3f83cae6ac14066855acb39b99294e7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:33.185550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:33.187027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:33.199857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c2fff-980c-45dd-9cc7-54fa13a13a66 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:33.267366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:33.268270 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:33.268550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:33.268820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] PATH_INFO: `/v3/users/579f79ddf6574d2dbb89e4497468ccdf` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:33.270010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579f79ddf6574d2dbb89e4497468ccdf)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:33.271993 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:33.321680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579f79ddf6574d2dbb89e4497468ccdf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.322411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579f79ddf6574d2dbb89e4497468ccdf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.330700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579f79ddf6574d2dbb89e4497468ccdf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.343266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579f79ddf6574d2dbb89e4497468ccdf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.350223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579f79ddf6574d2dbb89e4497468ccdf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.356116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1227/2431] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:41:33 2022] DELETE /identity/v3/users/579f79ddf6574d2dbb89e4497468ccdf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:33.549669 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:33.551242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:33.574457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee15c8f-60f6-4bc7-a493-26530b546274 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:33.632340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:33.633133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:33.633412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:33.633686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] PATH_INFO: `/v3/projects/6cd33a7ec91b4cc288fd18191331bf23` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:33.634885 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd33a7ec91b4cc288fd18191331bf23)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:33.636814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:33.682515 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd33a7ec91b4cc288fd18191331bf23', 'request_id': 'req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.687876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd33a7ec91b4cc288fd18191331bf23', 'request_id': 'req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.693725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd33a7ec91b4cc288fd18191331bf23', 'request_id': 'req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.706035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] The token cache is being invalidate because project 6cd33a7ec91b4cc288fd18191331bf23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:41:33.706318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.706953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:41:33.708443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1205/2432] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:41:33 2022] DELETE /identity/v3/projects/6cd33a7ec91b4cc288fd18191331bf23 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:41:35.514029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:35.515570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:35.577867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e52090-f66b-4022-be74-10151ae63b37 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:35.608820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:35.631223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c02a1-b176-49a5-9d4b-86b0cf738742 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe27c3402a741f0a80d87ae6ecd3f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:35.631896 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c02a1-b176-49a5-9d4b-86b0cf738742 service glance] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:35.632184 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c02a1-b176-49a5-9d4b-86b0cf738742 service glance] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:35.632465 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c02a1-b176-49a5-9d4b-86b0cf738742 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:35.634316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dd8c02a1-b176-49a5-9d4b-86b0cf738742 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:35.708007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c02a1-b176-49a5-9d4b-86b0cf738742 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:35.709661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c02a1-b176-49a5-9d4b-86b0cf738742 service glance] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:35.722404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1228/2433] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:41:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:41:35.791500 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:35.793012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:35.847325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:35.854012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365b05-d79b-44f4-b4bc-43e2d8a5171f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:35.859618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad93ce5-e4a2-4beb-82e8-14d825bfc8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:35.860287 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad93ce5-e4a2-4beb-82e8-14d825bfc8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:35.860578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad93ce5-e4a2-4beb-82e8-14d825bfc8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:35.860856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad93ce5-e4a2-4beb-82e8-14d825bfc8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:35.863041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3ad93ce5-e4a2-4beb-82e8-14d825bfc8e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:35.874912 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad93ce5-e4a2-4beb-82e8-14d825bfc8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:35.876379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad93ce5-e4a2-4beb-82e8-14d825bfc8e6 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:35.885533 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1206/2434] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:41:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:41:35.968831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c02a1-b176-49a5-9d4b-86b0cf738742 service glance] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:35.970263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dd8c02a1-b176-49a5-9d4b-86b0cf738742 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:35.981813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c02a1-b176-49a5-9d4b-86b0cf738742 service glance] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:35.985313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f1f91-c29e-4f47-8c6c-84e3e1f6926a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:35.985946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f1f91-c29e-4f47-8c6c-84e3e1f6926a service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:35.986226 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f1f91-c29e-4f47-8c6c-84e3e1f6926a service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:35.986544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f1f91-c29e-4f47-8c6c-84e3e1f6926a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:35.988256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9e4f1f91-c29e-4f47-8c6c-84e3e1f6926a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:36.001370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f1f91-c29e-4f47-8c6c-84e3e1f6926a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:36.002778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f1f91-c29e-4f47-8c6c-84e3e1f6926a service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:36.013845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1229/2435] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:41:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:41:37.458102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65ac13-6ec7-4e04-85da-5d7dcff73f0e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:37.458613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65ac13-6ec7-4e04-85da-5d7dcff73f0e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:37.458726 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65ac13-6ec7-4e04-85da-5d7dcff73f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:37.475946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1e65ac13-6ec7-4e04-85da-5d7dcff73f0e None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:37.477165 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1e65ac13-6ec7-4e04-85da-5d7dcff73f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:37.529421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1207/2436] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Jun 24 10:41:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:37.541840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f1f91-c29e-4f47-8c6c-84e3e1f6926a service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:37.543258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-9e4f1f91-c29e-4f47-8c6c-84e3e1f6926a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:37.610643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f1f91-c29e-4f47-8c6c-84e3e1f6926a service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:37.615474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce3d71-276d-42b3-b1dc-55e971bc9fd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:37.616111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce3d71-276d-42b3-b1dc-55e971bc9fd6 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:37.616392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce3d71-276d-42b3-b1dc-55e971bc9fd6 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:37.616663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce3d71-276d-42b3-b1dc-55e971bc9fd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:37.624694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce3d71-276d-42b3-b1dc-55e971bc9fd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:37.626256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce3d71-276d-42b3-b1dc-55e971bc9fd6 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:37.634319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1230/2437] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:41:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:41:47.522584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=30 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:47.631013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=78 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:41:59.455928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e85d9-7faa-4668-95d5-643370a94ad6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:59.456429 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e85d9-7faa-4668-95d5-643370a94ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:59.456530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e85d9-7faa-4668-95d5-643370a94ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:59.474565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-377e85d9-7faa-4668-95d5-643370a94ad6 None None] MFA Rules not processed for user `f75e1cb00d8b44988b660c753d498f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:41:59.475769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-377e85d9-7faa-4668-95d5-643370a94ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:41:59.482891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1208/2438] 10.222.0.44 () {58 vars in 967 bytes} [Fri Jun 24 10:41:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:41:59.496040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce3d71-276d-42b3-b1dc-55e971bc9fd6 service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:41:59.506533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce3d71-276d-42b3-b1dc-55e971bc9fd6 service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:41:59.511507 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b571151-c471-4bfb-a638-e76afe1791f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67ae1a0fbb4f44e6b60281ce63dc68fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:41:59.512137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b571151-c471-4bfb-a638-e76afe1791f5 service swift] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:41:59.512438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b571151-c471-4bfb-a638-e76afe1791f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:41:59.512702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b571151-c471-4bfb-a638-e76afe1791f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:41:59.520582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b571151-c471-4bfb-a638-e76afe1791f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:41:59.522162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b571151-c471-4bfb-a638-e76afe1791f5 service swift] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:41:59.530092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1231/2439] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Jun 24 10:41:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 10:42:09.469155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:09.526953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=6 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:13.478454 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e85d9-7faa-4668-95d5-643370a94ad6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:13.487705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e85d9-7faa-4668-95d5-643370a94ad6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:13.491232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ccb7b-a627-4961-9da2-03d0b0b87b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:13.491866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ccb7b-a627-4961-9da2-03d0b0b87b6a service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:13.492149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ccb7b-a627-4961-9da2-03d0b0b87b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:13.492425 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ccb7b-a627-4961-9da2-03d0b0b87b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:13.494577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b47ccb7b-a627-4961-9da2-03d0b0b87b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:13.555905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ccb7b-a627-4961-9da2-03d0b0b87b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:13.557323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ccb7b-a627-4961-9da2-03d0b0b87b6a service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:13.567155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1209/2440] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:16.645448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b571151-c471-4bfb-a638-e76afe1791f5 service swift] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:16.646953 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8b571151-c471-4bfb-a638-e76afe1791f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:16.661492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b571151-c471-4bfb-a638-e76afe1791f5 service swift] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:16.665970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:16.666898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:16.667182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:16.667464 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] PATH_INFO: `/v3/users/1b925b5e87dc489db1dd5e994e47e5e7` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:16.681682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b925b5e87dc489db1dd5e994e47e5e7)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:16.683644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:16.728509 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b925b5e87dc489db1dd5e994e47e5e7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:16.729156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b925b5e87dc489db1dd5e994e47e5e7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:16.736937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b925b5e87dc489db1dd5e994e47e5e7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:16.749348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b925b5e87dc489db1dd5e994e47e5e7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:16.756053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-09c1f1fe-bfaf-4dc8-a39e-0cfef3c4a053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b925b5e87dc489db1dd5e994e47e5e7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:16.761967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1232/2441] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:16 2022] DELETE /identity/v3/users/1b925b5e87dc489db1dd5e994e47e5e7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:16.939263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ccb7b-a627-4961-9da2-03d0b0b87b6a service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:16.950504 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ccb7b-a627-4961-9da2-03d0b0b87b6a service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:17.009300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:17.010126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.010444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.010724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] PATH_INFO: `/v3/projects/eb1eff66e8ef4283a28fecafbff9c1f1` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.021661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1eff66e8ef4283a28fecafbff9c1f1)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:17.023634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:17.067839 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1eff66e8ef4283a28fecafbff9c1f1', 'request_id': 'req-868c5207-bcf6-40bd-9f2b-2022fddd4940'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:17.073254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1eff66e8ef4283a28fecafbff9c1f1', 'request_id': 'req-868c5207-bcf6-40bd-9f2b-2022fddd4940'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:17.080437 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1eff66e8ef4283a28fecafbff9c1f1', 'request_id': 'req-868c5207-bcf6-40bd-9f2b-2022fddd4940'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:17.092410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] The token cache is being invalidate because project eb1eff66e8ef4283a28fecafbff9c1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:17.092701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:17.093337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-868c5207-bcf6-40bd-9f2b-2022fddd4940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:17.094916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1210/2442] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:16 2022] DELETE /identity/v3/projects/eb1eff66e8ef4283a28fecafbff9c1f1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:17.100340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81999b-3fd8-46ae-83ee-686ac7ed568b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.100636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81999b-3fd8-46ae-83ee-686ac7ed568b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.100917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81999b-3fd8-46ae-83ee-686ac7ed568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.118493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ed81999b-3fd8-46ae-83ee-686ac7ed568b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:17.119738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ed81999b-3fd8-46ae-83ee-686ac7ed568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:17.178193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1233/2443] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:17.186272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8567-23b6-4ee9-8f44-2c01f626911a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.186655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8567-23b6-4ee9-8f44-2c01f626911a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.186939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8567-23b6-4ee9-8f44-2c01f626911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.203948 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ba1c8567-23b6-4ee9-8f44-2c01f626911a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:17.205644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ba1c8567-23b6-4ee9-8f44-2c01f626911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:17.213390 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1211/2444] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:17.217445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81999b-3fd8-46ae-83ee-686ac7ed568b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:17.227659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81999b-3fd8-46ae-83ee-686ac7ed568b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:17.232221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146a58b-f32b-41a3-aa87-03c48a48c51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:17.232861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146a58b-f32b-41a3-aa87-03c48a48c51a admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.233142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146a58b-f32b-41a3-aa87-03c48a48c51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.233416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146a58b-f32b-41a3-aa87-03c48a48c51a admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.234129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146a58b-f32b-41a3-aa87-03c48a48c51a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:17.234466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146a58b-f32b-41a3-aa87-03c48a48c51a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:17.236052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146a58b-f32b-41a3-aa87-03c48a48c51a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:17.247778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1234/2445] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:42:17.252064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c8567-23b6-4ee9-8f44-2c01f626911a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:17.261689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c8567-23b6-4ee9-8f44-2c01f626911a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:17.266247 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f819515-92e9-44a9-8ba9-de317744f5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:17.266921 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f819515-92e9-44a9-8ba9-de317744f5fd admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.267205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f819515-92e9-44a9-8ba9-de317744f5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.267990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f819515-92e9-44a9-8ba9-de317744f5fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.268673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f819515-92e9-44a9-8ba9-de317744f5fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:17.270583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f819515-92e9-44a9-8ba9-de317744f5fd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:17.274588 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:17.297815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1212/2446] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:17 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:17.301951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146a58b-f32b-41a3-aa87-03c48a48c51a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:17.312004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146a58b-f32b-41a3-aa87-03c48a48c51a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:17.356963 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:17.370659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac2890-e6a6-4acf-a69d-50b61c5f4ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:17.371399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac2890-e6a6-4acf-a69d-50b61c5f4ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.371685 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac2890-e6a6-4acf-a69d-50b61c5f4ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.371965 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac2890-e6a6-4acf-a69d-50b61c5f4ebd admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.372652 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac2890-e6a6-4acf-a69d-50b61c5f4ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:17.374754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac2890-e6a6-4acf-a69d-50b61c5f4ebd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:17.395683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1235/2447] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:17 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:17.399786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f819515-92e9-44a9-8ba9-de317744f5fd admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:17.410147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f819515-92e9-44a9-8ba9-de317744f5fd admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:17.415063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c345b-9076-4307-acd8-327e6ddb7761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:17.415735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c345b-9076-4307-acd8-327e6ddb7761 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.416003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c345b-9076-4307-acd8-327e6ddb7761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.416277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c345b-9076-4307-acd8-327e6ddb7761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.417003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c345b-9076-4307-acd8-327e6ddb7761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:17.418620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c345b-9076-4307-acd8-327e6ddb7761 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:17.428492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1213/2448] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:17.432313 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac2890-e6a6-4acf-a69d-50b61c5f4ebd admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:17.442607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac2890-e6a6-4acf-a69d-50b61c5f4ebd admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:17.448463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dacd1-265b-4458-b08d-9ffee7715ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:17.449208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dacd1-265b-4458-b08d-9ffee7715ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.449598 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dacd1-265b-4458-b08d-9ffee7715ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.449943 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dacd1-265b-4458-b08d-9ffee7715ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.450739 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dacd1-265b-4458-b08d-9ffee7715ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:17.452339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dacd1-265b-4458-b08d-9ffee7715ce6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:17.464868 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1236/2449] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:17.474100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c345b-9076-4307-acd8-327e6ddb7761 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:17.484193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c345b-9076-4307-acd8-327e6ddb7761 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:17.488768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19168875-f709-4e12-93a8-ff06186c3821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:17.489636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19168875-f709-4e12-93a8-ff06186c3821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.489916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19168875-f709-4e12-93a8-ff06186c3821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.490190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19168875-f709-4e12-93a8-ff06186c3821 admin admin] PATH_INFO: `/v3/projects/845315abaf03401d9924d12098430b14/users/4de0143cfc604030941c4635f4de0470/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.505210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19168875-f709-4e12-93a8-ff06186c3821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845315abaf03401d9924d12098430b14, user_id=4de0143cfc604030941c4635f4de0470, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:17.507973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19168875-f709-4e12-93a8-ff06186c3821 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:17.521655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1214/2450] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:17 2022] PUT /identity/v3/projects/845315abaf03401d9924d12098430b14/users/4de0143cfc604030941c4635f4de0470/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:17.531730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352f0f6-42fe-45a1-b1e8-d01706d0b43a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.532206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352f0f6-42fe-45a1-b1e8-d01706d0b43a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.532561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352f0f6-42fe-45a1-b1e8-d01706d0b43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.557944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c352f0f6-42fe-45a1-b1e8-d01706d0b43a None None] MFA Rules not processed for user `4de0143cfc604030941c4635f4de0470`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:17.559177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c352f0f6-42fe-45a1-b1e8-d01706d0b43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:17.625172 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1237/2451] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:17.635578 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19168875-f709-4e12-93a8-ff06186c3821 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:17.637276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-19168875-f709-4e12-93a8-ff06186c3821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:17.711705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19168875-f709-4e12-93a8-ff06186c3821 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:17.717210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c427c-11dd-456c-8090-b80b06eb22e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:17.717844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c427c-11dd-456c-8090-b80b06eb22e8 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:17.718127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c427c-11dd-456c-8090-b80b06eb22e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:17.718442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c427c-11dd-456c-8090-b80b06eb22e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:17.726735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c427c-11dd-456c-8090-b80b06eb22e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:17.728302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c427c-11dd-456c-8090-b80b06eb22e8 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:17.736954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1215/2452] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:19.181044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352f0f6-42fe-45a1-b1e8-d01706d0b43a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:19.182473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c352f0f6-42fe-45a1-b1e8-d01706d0b43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:19.238505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352f0f6-42fe-45a1-b1e8-d01706d0b43a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:19.241955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a15e9-f3bb-463d-b0b3-a90f69e9f355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:19.242618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a15e9-f3bb-463d-b0b3-a90f69e9f355 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:19.242902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a15e9-f3bb-463d-b0b3-a90f69e9f355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:19.243437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a15e9-f3bb-463d-b0b3-a90f69e9f355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:19.245147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d66a15e9-f3bb-463d-b0b3-a90f69e9f355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:19.258867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a15e9-f3bb-463d-b0b3-a90f69e9f355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:19.260280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a15e9-f3bb-463d-b0b3-a90f69e9f355 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:19.270952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1238/2453] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:20.601754 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c427c-11dd-456c-8090-b80b06eb22e8 service nova] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:20.603156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ad2c427c-11dd-456c-8090-b80b06eb22e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:20.615260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c427c-11dd-456c-8090-b80b06eb22e8 service nova] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:20.619015 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd39ca3-047d-498d-8008-8df121e35caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:20.619638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd39ca3-047d-498d-8008-8df121e35caa service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:20.619920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd39ca3-047d-498d-8008-8df121e35caa service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:20.620194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd39ca3-047d-498d-8008-8df121e35caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:20.621887 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-efd39ca3-047d-498d-8008-8df121e35caa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:20.636082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd39ca3-047d-498d-8008-8df121e35caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:20.637518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd39ca3-047d-498d-8008-8df121e35caa service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:20.648984 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1216/2454] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:23.039482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a15e9-f3bb-463d-b0b3-a90f69e9f355 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:23.096861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a15e9-f3bb-463d-b0b3-a90f69e9f355 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:23.101895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:23.102903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:23.103185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:23.103464 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] PATH_INFO: `/v3/users/4de0143cfc604030941c4635f4de0470` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:23.104626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de0143cfc604030941c4635f4de0470)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:23.106554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:23.108011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:23.152570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de0143cfc604030941c4635f4de0470'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:23.153213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de0143cfc604030941c4635f4de0470'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:23.160794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de0143cfc604030941c4635f4de0470'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:23.172621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de0143cfc604030941c4635f4de0470'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:23.179401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de0143cfc604030941c4635f4de0470'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:23.185250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1239/2455] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:23 2022] DELETE /identity/v3/users/4de0143cfc604030941c4635f4de0470 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:42:23.189777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3051e8a-5a3e-4a02-96be-32d66870b6f3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:23.190252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3051e8a-5a3e-4a02-96be-32d66870b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:23.190387 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3051e8a-5a3e-4a02-96be-32d66870b6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:23.207421 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d3051e8a-5a3e-4a02-96be-32d66870b6f3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:23.208616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d3051e8a-5a3e-4a02-96be-32d66870b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:23.265753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1217/2456] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:23.275777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:23.277144 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:23.333704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd055ce-0b68-46ab-b9e9-23dc6da7d31d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:23.337270 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fb598-7840-4dcc-95b3-091b327f2057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:23.338403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fb598-7840-4dcc-95b3-091b327f2057 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:23.338700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fb598-7840-4dcc-95b3-091b327f2057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:23.338973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fb598-7840-4dcc-95b3-091b327f2057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:23.347855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fb598-7840-4dcc-95b3-091b327f2057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:23.349276 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fb598-7840-4dcc-95b3-091b327f2057 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:23.358628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1240/2457] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:23.628806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3051e8a-5a3e-4a02-96be-32d66870b6f3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:23.630301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d3051e8a-5a3e-4a02-96be-32d66870b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:23.642651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3051e8a-5a3e-4a02-96be-32d66870b6f3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:23.647965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:23.648895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:23.649253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:23.649602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] PATH_INFO: `/v3/projects/845315abaf03401d9924d12098430b14` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:23.650907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=845315abaf03401d9924d12098430b14)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:23.652888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:23.675512 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:23.701602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845315abaf03401d9924d12098430b14', 'request_id': 'req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:23.707542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845315abaf03401d9924d12098430b14', 'request_id': 'req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:23.713847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845315abaf03401d9924d12098430b14', 'request_id': 'req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:23.725615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] The token cache is being invalidate because project 845315abaf03401d9924d12098430b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:23.725901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:23.726556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-9ef8d964-9508-4d16-9cc3-d54d586bc7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:23.728105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1218/2458] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:23 2022] DELETE /identity/v3/projects/845315abaf03401d9924d12098430b14 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:23.732980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04319e3-0c11-411e-a62e-b1bf4585356c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:23.733272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04319e3-0c11-411e-a62e-b1bf4585356c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:23.733549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04319e3-0c11-411e-a62e-b1bf4585356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:23.751345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d04319e3-0c11-411e-a62e-b1bf4585356c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:23.752527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d04319e3-0c11-411e-a62e-b1bf4585356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:23.809980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1241/2459] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:23.818525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322e1a-4f92-49fe-a3ae-127d505065e3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:23.818814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322e1a-4f92-49fe-a3ae-127d505065e3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:23.819114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322e1a-4f92-49fe-a3ae-127d505065e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:23.836916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-45322e1a-4f92-49fe-a3ae-127d505065e3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:23.838114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-45322e1a-4f92-49fe-a3ae-127d505065e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:23.845925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1219/2460] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:23.849904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04319e3-0c11-411e-a62e-b1bf4585356c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:23.859622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04319e3-0c11-411e-a62e-b1bf4585356c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:23.864775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff53c88-c6b2-45b8-8d20-d9d31364ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:23.865432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53c88-c6b2-45b8-8d20-d9d31364ed67 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:23.865771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53c88-c6b2-45b8-8d20-d9d31364ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:23.866050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53c88-c6b2-45b8-8d20-d9d31364ed67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:23.866802 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff53c88-c6b2-45b8-8d20-d9d31364ed67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:23.867112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff53c88-c6b2-45b8-8d20-d9d31364ed67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:23.868999 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff53c88-c6b2-45b8-8d20-d9d31364ed67 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:23.881159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1242/2461] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:23.885193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45322e1a-4f92-49fe-a3ae-127d505065e3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:23.894262 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45322e1a-4f92-49fe-a3ae-127d505065e3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:23.898898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb398837-234c-4ed6-86d5-0a1076f73354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:23.899534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb398837-234c-4ed6-86d5-0a1076f73354 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:23.899818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb398837-234c-4ed6-86d5-0a1076f73354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:23.900092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb398837-234c-4ed6-86d5-0a1076f73354 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:23.900786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb398837-234c-4ed6-86d5-0a1076f73354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:23.902771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb398837-234c-4ed6-86d5-0a1076f73354 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:23.928316 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1220/2462] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:23 2022] POST /identity/v3/projects => generated 405 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:42:23.932280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff53c88-c6b2-45b8-8d20-d9d31364ed67 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:23.942649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff53c88-c6b2-45b8-8d20-d9d31364ed67 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:23.947227 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:23.999523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab91316-389c-4ae2-8ce1-e33902bb75bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.000213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91316-389c-4ae2-8ce1-e33902bb75bc admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.000573 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91316-389c-4ae2-8ce1-e33902bb75bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.001159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91316-389c-4ae2-8ce1-e33902bb75bc admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.001677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab91316-389c-4ae2-8ce1-e33902bb75bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.004323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab91316-389c-4ae2-8ce1-e33902bb75bc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.024243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1243/2463] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:23 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:24.028589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb398837-234c-4ed6-86d5-0a1076f73354 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:24.038943 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb398837-234c-4ed6-86d5-0a1076f73354 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:24.043472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca00c5f-316f-4ee9-974a-3f79b16f5598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.044125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca00c5f-316f-4ee9-974a-3f79b16f5598 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.044409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca00c5f-316f-4ee9-974a-3f79b16f5598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.044687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca00c5f-316f-4ee9-974a-3f79b16f5598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.045408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca00c5f-316f-4ee9-974a-3f79b16f5598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.047049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca00c5f-316f-4ee9-974a-3f79b16f5598 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.057678 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1221/2464] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:42:24.061494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab91316-389c-4ae2-8ce1-e33902bb75bc admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:24.072036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab91316-389c-4ae2-8ce1-e33902bb75bc admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:24.076667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eb364-7897-4feb-afcf-3775967b6929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.077319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb364-7897-4feb-afcf-3775967b6929 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.077609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb364-7897-4feb-afcf-3775967b6929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.077897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb364-7897-4feb-afcf-3775967b6929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.078665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eb364-7897-4feb-afcf-3775967b6929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.080261 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eb364-7897-4feb-afcf-3775967b6929 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.090201 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1244/2465] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:24.094196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca00c5f-316f-4ee9-974a-3f79b16f5598 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:24.104520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca00c5f-316f-4ee9-974a-3f79b16f5598 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:24.109083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819806d7-097e-4490-af97-2c31e4eb6af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.109937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819806d7-097e-4490-af97-2c31e4eb6af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.110218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819806d7-097e-4490-af97-2c31e4eb6af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.110523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819806d7-097e-4490-af97-2c31e4eb6af4 admin admin] PATH_INFO: `/v3/projects/f42f794dbd674f75868c476bc43d347c/users/e2f94245a80e4d1e989a547ae2b8da61/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.125345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819806d7-097e-4490-af97-2c31e4eb6af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42f794dbd674f75868c476bc43d347c, user_id=e2f94245a80e4d1e989a547ae2b8da61, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.128160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819806d7-097e-4490-af97-2c31e4eb6af4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.140248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1222/2466] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:24 2022] PUT /identity/v3/projects/f42f794dbd674f75868c476bc43d347c/users/e2f94245a80e4d1e989a547ae2b8da61/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:24.150441 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743af48c-f8b2-46d0-9410-9af05342ba8a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.150840 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743af48c-f8b2-46d0-9410-9af05342ba8a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.151191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743af48c-f8b2-46d0-9410-9af05342ba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.178103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-743af48c-f8b2-46d0-9410-9af05342ba8a None None] MFA Rules not processed for user `e2f94245a80e4d1e989a547ae2b8da61`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:24.179408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-743af48c-f8b2-46d0-9410-9af05342ba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:24.241814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1245/2467] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:24.246503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819806d7-097e-4490-af97-2c31e4eb6af4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:24.312362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819806d7-097e-4490-af97-2c31e4eb6af4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:24.316992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a92bf-50c8-42ab-aa4c-bb591d065fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.317640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a92bf-50c8-42ab-aa4c-bb591d065fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.317923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a92bf-50c8-42ab-aa4c-bb591d065fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.318198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a92bf-50c8-42ab-aa4c-bb591d065fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.318903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a92bf-50c8-42ab-aa4c-bb591d065fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.320781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a92bf-50c8-42ab-aa4c-bb591d065fe8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.345374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1223/2468] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:24 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:24.349987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743af48c-f8b2-46d0-9410-9af05342ba8a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:24.360591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743af48c-f8b2-46d0-9410-9af05342ba8a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:24.416408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362f91-175d-400b-9e1e-686ca9015c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.417073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362f91-175d-400b-9e1e-686ca9015c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.417356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362f91-175d-400b-9e1e-686ca9015c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.417632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362f91-175d-400b-9e1e-686ca9015c8d admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.418324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd362f91-175d-400b-9e1e-686ca9015c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.420315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd362f91-175d-400b-9e1e-686ca9015c8d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.440475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1246/2469] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:24 2022] POST /identity/v3/users => generated 308 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:24.444434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a92bf-50c8-42ab-aa4c-bb591d065fe8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:24.455450 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a92bf-50c8-42ab-aa4c-bb591d065fe8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:24.460553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14f205-4a59-4c19-989f-e010ca7250b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.461201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14f205-4a59-4c19-989f-e010ca7250b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.461485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14f205-4a59-4c19-989f-e010ca7250b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.461763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14f205-4a59-4c19-989f-e010ca7250b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.462514 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14f205-4a59-4c19-989f-e010ca7250b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.464112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14f205-4a59-4c19-989f-e010ca7250b9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.474965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1224/2470] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:24.478958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362f91-175d-400b-9e1e-686ca9015c8d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:24.488830 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362f91-175d-400b-9e1e-686ca9015c8d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:24.493657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fe809-4882-4077-8555-a865c8ce9465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.494551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fe809-4882-4077-8555-a865c8ce9465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.494837 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fe809-4882-4077-8555-a865c8ce9465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.495114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fe809-4882-4077-8555-a865c8ce9465 admin admin] PATH_INFO: `/v3/projects/7cc6586fc45c4f2ba4700f80af2a41ab/users/e2a0bfc72fad43b58bb5872252d1b10b/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.497439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:24.513027 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fe809-4882-4077-8555-a865c8ce9465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc6586fc45c4f2ba4700f80af2a41ab, user_id=e2a0bfc72fad43b58bb5872252d1b10b, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.515721 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fe809-4882-4077-8555-a865c8ce9465 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.528432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1247/2471] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:24 2022] PUT /identity/v3/projects/7cc6586fc45c4f2ba4700f80af2a41ab/users/e2a0bfc72fad43b58bb5872252d1b10b/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:24.533009 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14f205-4a59-4c19-989f-e010ca7250b9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:24.545067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14f205-4a59-4c19-989f-e010ca7250b9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:24.557431 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:24.604861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baefda7-e342-4a49-9845-0867022d5b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.605523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baefda7-e342-4a49-9845-0867022d5b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.605806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baefda7-e342-4a49-9845-0867022d5b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.606084 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baefda7-e342-4a49-9845-0867022d5b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.606834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baefda7-e342-4a49-9845-0867022d5b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.608424 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baefda7-e342-4a49-9845-0867022d5b60 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.618437 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1225/2472] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:24.622791 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fe809-4882-4077-8555-a865c8ce9465 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:24.632863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fe809-4882-4077-8555-a865c8ce9465 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:24.637448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d5bf3-2202-446e-a8a7-e606933b16bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.638319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d5bf3-2202-446e-a8a7-e606933b16bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.638634 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d5bf3-2202-446e-a8a7-e606933b16bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.638911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d5bf3-2202-446e-a8a7-e606933b16bd admin admin] PATH_INFO: `/v3/projects/7cc6586fc45c4f2ba4700f80af2a41ab/users/e2a0bfc72fad43b58bb5872252d1b10b/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.640886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d5bf3-2202-446e-a8a7-e606933b16bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc6586fc45c4f2ba4700f80af2a41ab, user_id=e2a0bfc72fad43b58bb5872252d1b10b, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.643538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d5bf3-2202-446e-a8a7-e606933b16bd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.654092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1248/2473] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:24 2022] PUT /identity/v3/projects/7cc6586fc45c4f2ba4700f80af2a41ab/users/e2a0bfc72fad43b58bb5872252d1b10b/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:42:24.665981 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e8e58-b16d-4e46-95d4-9399775afede None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.666273 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e8e58-b16d-4e46-95d4-9399775afede None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.666606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e8e58-b16d-4e46-95d4-9399775afede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.692206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-887e8e58-b16d-4e46-95d4-9399775afede None None] MFA Rules not processed for user `e2a0bfc72fad43b58bb5872252d1b10b`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:24.693409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-887e8e58-b16d-4e46-95d4-9399775afede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:24.759913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1226/2474] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:24.770838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d5bf3-2202-446e-a8a7-e606933b16bd admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:24.772558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-116d5bf3-2202-446e-a8a7-e606933b16bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:24.828365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d5bf3-2202-446e-a8a7-e606933b16bd admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:24.831859 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc0682-1f41-4e75-a393-a77843675c9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:24.832487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc0682-1f41-4e75-a393-a77843675c9e service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:24.833374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc0682-1f41-4e75-a393-a77843675c9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:24.833684 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc0682-1f41-4e75-a393-a77843675c9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:24.842450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc0682-1f41-4e75-a393-a77843675c9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:24.843861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc0682-1f41-4e75-a393-a77843675c9e service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:24.853367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1249/2475] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:24.984231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e8e58-b16d-4e46-95d4-9399775afede None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:25.045742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e8e58-b16d-4e46-95d4-9399775afede None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:25.050231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:25.051122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:25.051445 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:25.051724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] PATH_INFO: `/v3/users/e2f94245a80e4d1e989a547ae2b8da61` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:25.052896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2f94245a80e4d1e989a547ae2b8da61)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:25.054870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:25.096158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:25.102177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2f94245a80e4d1e989a547ae2b8da61'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.102853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2f94245a80e4d1e989a547ae2b8da61'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.103474 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2f94245a80e4d1e989a547ae2b8da61'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.115434 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2f94245a80e4d1e989a547ae2b8da61'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.122732 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2f94245a80e4d1e989a547ae2b8da61'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.135633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1227/2476] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:24 2022] DELETE /identity/v3/users/e2f94245a80e4d1e989a547ae2b8da61 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:25.140208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad8b26-e88b-4565-9f2a-d2ae1c079942 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:25.140723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad8b26-e88b-4565-9f2a-d2ae1c079942 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:25.140834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad8b26-e88b-4565-9f2a-d2ae1c079942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:25.158769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1dad8b26-e88b-4565-9f2a-d2ae1c079942 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:25.159970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1dad8b26-e88b-4565-9f2a-d2ae1c079942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:25.221720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1250/2477] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:25.231784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:25.233310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:25.289861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6f170-c147-4b6c-ac84-cc135515744c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:25.293460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246d8b9-6534-4344-a1cb-4bec6e8b7410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:25.294095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246d8b9-6534-4344-a1cb-4bec6e8b7410 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:25.294396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246d8b9-6534-4344-a1cb-4bec6e8b7410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:25.294672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246d8b9-6534-4344-a1cb-4bec6e8b7410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:25.304054 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246d8b9-6534-4344-a1cb-4bec6e8b7410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:25.305462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246d8b9-6534-4344-a1cb-4bec6e8b7410 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:25.315093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1228/2478] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:25.579712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad8b26-e88b-4565-9f2a-d2ae1c079942 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:25.581224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1dad8b26-e88b-4565-9f2a-d2ae1c079942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:25.599413 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad8b26-e88b-4565-9f2a-d2ae1c079942 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:25.604239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:25.605110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:25.605395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:25.605672 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] PATH_INFO: `/v3/projects/f42f794dbd674f75868c476bc43d347c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:25.606886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42f794dbd674f75868c476bc43d347c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:25.609007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:25.655251 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42f794dbd674f75868c476bc43d347c', 'request_id': 'req-aaa743f0-9423-49ac-81bd-df110c359e59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.663444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42f794dbd674f75868c476bc43d347c', 'request_id': 'req-aaa743f0-9423-49ac-81bd-df110c359e59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.669043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42f794dbd674f75868c476bc43d347c', 'request_id': 'req-aaa743f0-9423-49ac-81bd-df110c359e59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.670938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:25.683815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] The token cache is being invalidate because project f42f794dbd674f75868c476bc43d347c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:25.684109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.685114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.686754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1251/2479] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:25 2022] DELETE /identity/v3/projects/f42f794dbd674f75868c476bc43d347c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:25.690896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246d8b9-6534-4344-a1cb-4bec6e8b7410 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:25.700517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246d8b9-6534-4344-a1cb-4bec6e8b7410 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:25.757381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:25.758242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:25.758557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:25.758837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] PATH_INFO: `/v3/users/e2a0bfc72fad43b58bb5872252d1b10b` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:25.760022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a0bfc72fad43b58bb5872252d1b10b)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:25.761929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:25.806672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a0bfc72fad43b58bb5872252d1b10b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.807327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a0bfc72fad43b58bb5872252d1b10b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.807940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a0bfc72fad43b58bb5872252d1b10b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.819354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:25.820597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a0bfc72fad43b58bb5872252d1b10b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.828640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-48c8ffd8-92a0-40fb-a3cb-6a385e51dc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a0bfc72fad43b58bb5872252d1b10b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:25.841184 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1229/2480] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:25 2022] DELETE /identity/v3/users/e2a0bfc72fad43b58bb5872252d1b10b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:26.109382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:26.110981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:26.124799 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa743f0-9423-49ac-81bd-df110c359e59 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:26.182335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:26.183214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.183501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.183779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] PATH_INFO: `/v3/projects/7cc6586fc45c4f2ba4700f80af2a41ab` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.184955 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc6586fc45c4f2ba4700f80af2a41ab)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:26.187001 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:26.232825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc6586fc45c4f2ba4700f80af2a41ab', 'request_id': 'req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:26.239623 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc6586fc45c4f2ba4700f80af2a41ab', 'request_id': 'req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:26.245416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc6586fc45c4f2ba4700f80af2a41ab', 'request_id': 'req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:26.256924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] The token cache is being invalidate because project 7cc6586fc45c4f2ba4700f80af2a41ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:26.257212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:26.257898 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-9c6ce964-0eb4-4fcf-b431-0ac169aebd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:26.259553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1252/2481] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:26 2022] DELETE /identity/v3/projects/7cc6586fc45c4f2ba4700f80af2a41ab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:26.264787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e1ce9-12e0-43b1-8f8e-a49c01ca7d2c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.265074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e1ce9-12e0-43b1-8f8e-a49c01ca7d2c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.265353 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e1ce9-12e0-43b1-8f8e-a49c01ca7d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.283342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-937e1ce9-12e0-43b1-8f8e-a49c01ca7d2c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:26.284541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-937e1ce9-12e0-43b1-8f8e-a49c01ca7d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:26.342529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1230/2482] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:42:26.350113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3782f-91ce-4492-b6fb-24bc24ea17cf None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.350437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3782f-91ce-4492-b6fb-24bc24ea17cf None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.350723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3782f-91ce-4492-b6fb-24bc24ea17cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.368954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-bed3782f-91ce-4492-b6fb-24bc24ea17cf None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:26.370158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bed3782f-91ce-4492-b6fb-24bc24ea17cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:26.378017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1253/2483] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:26.382744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e1ce9-12e0-43b1-8f8e-a49c01ca7d2c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:26.392352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e1ce9-12e0-43b1-8f8e-a49c01ca7d2c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:26.397757 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2db467-6426-47f3-a35a-210706df387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:26.398559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2db467-6426-47f3-a35a-210706df387f admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.398843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2db467-6426-47f3-a35a-210706df387f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.399115 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2db467-6426-47f3-a35a-210706df387f admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.399835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2db467-6426-47f3-a35a-210706df387f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:26.400140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2db467-6426-47f3-a35a-210706df387f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:26.401722 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2db467-6426-47f3-a35a-210706df387f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:26.413028 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1231/2484] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:26.417121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3782f-91ce-4492-b6fb-24bc24ea17cf None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:26.426163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3782f-91ce-4492-b6fb-24bc24ea17cf None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:26.430857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd471b8-12d6-4d0a-b99a-b4430db7bb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:26.431492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd471b8-12d6-4d0a-b99a-b4430db7bb13 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.431772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd471b8-12d6-4d0a-b99a-b4430db7bb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.432045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd471b8-12d6-4d0a-b99a-b4430db7bb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.432725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd471b8-12d6-4d0a-b99a-b4430db7bb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:26.434658 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd471b8-12d6-4d0a-b99a-b4430db7bb13 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:26.460772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1254/2485] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:26 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:26.464559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2db467-6426-47f3-a35a-210706df387f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:26.475077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2db467-6426-47f3-a35a-210706df387f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:26.533230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fade68-51b3-4ddb-b2c3-e09e8cb01aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:26.533910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fade68-51b3-4ddb-b2c3-e09e8cb01aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.534258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fade68-51b3-4ddb-b2c3-e09e8cb01aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.534536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fade68-51b3-4ddb-b2c3-e09e8cb01aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.535263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fade68-51b3-4ddb-b2c3-e09e8cb01aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:26.537127 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fade68-51b3-4ddb-b2c3-e09e8cb01aa3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:26.561492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1232/2486] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:26 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:26.562888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd471b8-12d6-4d0a-b99a-b4430db7bb13 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:26.575013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd471b8-12d6-4d0a-b99a-b4430db7bb13 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:26.579701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f960d-1942-4921-bea8-dc5f7becc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:26.580363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f960d-1942-4921-bea8-dc5f7becc1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.580647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f960d-1942-4921-bea8-dc5f7becc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.580924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f960d-1942-4921-bea8-dc5f7becc1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.581651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f960d-1942-4921-bea8-dc5f7becc1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:26.583990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f960d-1942-4921-bea8-dc5f7becc1f8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:26.595082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1255/2487] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:26.598936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fade68-51b3-4ddb-b2c3-e09e8cb01aa3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:26.609936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fade68-51b3-4ddb-b2c3-e09e8cb01aa3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:26.617884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab361aec-8a3c-4c5c-922d-5a077d79e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:26.618842 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab361aec-8a3c-4c5c-922d-5a077d79e602 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.619122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab361aec-8a3c-4c5c-922d-5a077d79e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.619392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab361aec-8a3c-4c5c-922d-5a077d79e602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.620118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab361aec-8a3c-4c5c-922d-5a077d79e602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:26.621704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab361aec-8a3c-4c5c-922d-5a077d79e602 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:26.633052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1233/2488] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:26.638162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f960d-1942-4921-bea8-dc5f7becc1f8 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:26.649179 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f960d-1942-4921-bea8-dc5f7becc1f8 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:26.654306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3547a6d-1df3-4e6b-8587-665bb52a7b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:26.655212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3547a6d-1df3-4e6b-8587-665bb52a7b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.655492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3547a6d-1df3-4e6b-8587-665bb52a7b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.655763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3547a6d-1df3-4e6b-8587-665bb52a7b49 admin admin] PATH_INFO: `/v3/projects/ebee6ea455a841cc9d0e16a476b92110/users/e8ceb60d151041aeb72b56528b640748/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.670695 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3547a6d-1df3-4e6b-8587-665bb52a7b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebee6ea455a841cc9d0e16a476b92110, user_id=e8ceb60d151041aeb72b56528b640748, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:26.673337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3547a6d-1df3-4e6b-8587-665bb52a7b49 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:26.686924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1256/2489] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:26 2022] PUT /identity/v3/projects/ebee6ea455a841cc9d0e16a476b92110/users/e8ceb60d151041aeb72b56528b640748/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:26.698039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c403-de2d-4b5c-b58b-8e08e9422c2a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.698332 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c403-de2d-4b5c-b58b-8e08e9422c2a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.698644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c403-de2d-4b5c-b58b-8e08e9422c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.725381 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-ab90c403-de2d-4b5c-b58b-8e08e9422c2a None None] MFA Rules not processed for user `e8ceb60d151041aeb72b56528b640748`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:26.726525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-ab90c403-de2d-4b5c-b58b-8e08e9422c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:26.760794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:26.793956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1234/2490] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:42:26.798733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3547a6d-1df3-4e6b-8587-665bb52a7b49 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:26.824530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:26.863359 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3547a6d-1df3-4e6b-8587-665bb52a7b49 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:26.868815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184b159-d851-40b8-ad88-f1beb5a540e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:26.869479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184b159-d851-40b8-ad88-f1beb5a540e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.869763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184b159-d851-40b8-ad88-f1beb5a540e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.870040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184b159-d851-40b8-ad88-f1beb5a540e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.870762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184b159-d851-40b8-ad88-f1beb5a540e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:26.872667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184b159-d851-40b8-ad88-f1beb5a540e0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:26.903373 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1257/2491] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:26 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:26.904689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90c403-de2d-4b5c-b58b-8e08e9422c2a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:26.915561 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90c403-de2d-4b5c-b58b-8e08e9422c2a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:26.971752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391896-23e0-4ea9-ba63-8c1d71cf0f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:26.972430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391896-23e0-4ea9-ba63-8c1d71cf0f7c admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:26.972716 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391896-23e0-4ea9-ba63-8c1d71cf0f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:26.972994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391896-23e0-4ea9-ba63-8c1d71cf0f7c admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:26.973706 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391896-23e0-4ea9-ba63-8c1d71cf0f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:26.975715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391896-23e0-4ea9-ba63-8c1d71cf0f7c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:26.996596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1235/2492] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:26 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:27.000580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184b159-d851-40b8-ad88-f1beb5a540e0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.011660 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184b159-d851-40b8-ad88-f1beb5a540e0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.016277 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b4c8-f710-465f-9f9c-716e946dc174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.016939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b4c8-f710-465f-9f9c-716e946dc174 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.017231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b4c8-f710-465f-9f9c-716e946dc174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.017576 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b4c8-f710-465f-9f9c-716e946dc174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.018250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095b4c8-f710-465f-9f9c-716e946dc174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.019925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095b4c8-f710-465f-9f9c-716e946dc174 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.031026 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1258/2493] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:27.034973 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391896-23e0-4ea9-ba63-8c1d71cf0f7c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.045444 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391896-23e0-4ea9-ba63-8c1d71cf0f7c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.050481 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fd431-c7c7-4e19-be86-68914bffd4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.051204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fd431-c7c7-4e19-be86-68914bffd4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.052096 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fd431-c7c7-4e19-be86-68914bffd4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.052433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fd431-c7c7-4e19-be86-68914bffd4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.053533 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fd431-c7c7-4e19-be86-68914bffd4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.055219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fd431-c7c7-4e19-be86-68914bffd4bf admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.065717 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1236/2494] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:42:27.069714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b4c8-f710-465f-9f9c-716e946dc174 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.080139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b4c8-f710-465f-9f9c-716e946dc174 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.084827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3452660-203e-410b-bdde-c9cb5f1d8786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.085707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3452660-203e-410b-bdde-c9cb5f1d8786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.085995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3452660-203e-410b-bdde-c9cb5f1d8786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.086280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3452660-203e-410b-bdde-c9cb5f1d8786 admin admin] PATH_INFO: `/v3/projects/5af534f5feda4385be4757bcea6853c9/users/2ba6022e4f9e428080363a5fbdbc4ea5/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.104356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3452660-203e-410b-bdde-c9cb5f1d8786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af534f5feda4385be4757bcea6853c9, user_id=2ba6022e4f9e428080363a5fbdbc4ea5, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.107147 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3452660-203e-410b-bdde-c9cb5f1d8786 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.120530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1259/2495] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:27 2022] PUT /identity/v3/projects/5af534f5feda4385be4757bcea6853c9/users/2ba6022e4f9e428080363a5fbdbc4ea5/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:42:27.132008 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03d3c5-4ecc-46da-aa35-06e91b7c57b5 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.132278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03d3c5-4ecc-46da-aa35-06e91b7c57b5 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.132554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03d3c5-4ecc-46da-aa35-06e91b7c57b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.157999 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-9f03d3c5-4ecc-46da-aa35-06e91b7c57b5 None None] MFA Rules not processed for user `2ba6022e4f9e428080363a5fbdbc4ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:27.159348 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9f03d3c5-4ecc-46da-aa35-06e91b7c57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:27.221883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1237/2496] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:27.226971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3452660-203e-410b-bdde-c9cb5f1d8786 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.287793 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3452660-203e-410b-bdde-c9cb5f1d8786 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.292261 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecdd1a-524b-45c4-8a20-99d8eec24fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.292906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecdd1a-524b-45c4-8a20-99d8eec24fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.293186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecdd1a-524b-45c4-8a20-99d8eec24fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.293461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecdd1a-524b-45c4-8a20-99d8eec24fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.294123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecdd1a-524b-45c4-8a20-99d8eec24fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.296105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecdd1a-524b-45c4-8a20-99d8eec24fc9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.321171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1260/2497] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:27 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:27.325235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03d3c5-4ecc-46da-aa35-06e91b7c57b5 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.335922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03d3c5-4ecc-46da-aa35-06e91b7c57b5 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.377602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:27.393398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649ce0d-cf60-4f8d-b811-00a1611320ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.394067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649ce0d-cf60-4f8d-b811-00a1611320ea admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.394386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649ce0d-cf60-4f8d-b811-00a1611320ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.394661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649ce0d-cf60-4f8d-b811-00a1611320ea admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.395369 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649ce0d-cf60-4f8d-b811-00a1611320ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.397299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649ce0d-cf60-4f8d-b811-00a1611320ea admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.417183 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1238/2498] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:27 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:27.421198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecdd1a-524b-45c4-8a20-99d8eec24fc9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.432007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecdd1a-524b-45c4-8a20-99d8eec24fc9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.436575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0cd7-7310-40fc-b33b-9e5b6b64e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.437223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0cd7-7310-40fc-b33b-9e5b6b64e451 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.437503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0cd7-7310-40fc-b33b-9e5b6b64e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.437777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0cd7-7310-40fc-b33b-9e5b6b64e451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.438541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff0cd7-7310-40fc-b33b-9e5b6b64e451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.440128 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff0cd7-7310-40fc-b33b-9e5b6b64e451 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.450857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1261/2499] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:27.454891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649ce0d-cf60-4f8d-b811-00a1611320ea admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.465048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649ce0d-cf60-4f8d-b811-00a1611320ea admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.469577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c1e51-7f3a-4e5c-806b-c7335d4ee25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.470465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c1e51-7f3a-4e5c-806b-c7335d4ee25e admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.470748 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c1e51-7f3a-4e5c-806b-c7335d4ee25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.471021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c1e51-7f3a-4e5c-806b-c7335d4ee25e admin admin] PATH_INFO: `/v3/projects/38239f821749434fa263d786b9dcdb4a/users/075280c62bc7465989ce8a5f88c41db1/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.486203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c1e51-7f3a-4e5c-806b-c7335d4ee25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38239f821749434fa263d786b9dcdb4a, user_id=075280c62bc7465989ce8a5f88c41db1, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.488867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c1e51-7f3a-4e5c-806b-c7335d4ee25e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.504733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1239/2500] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:27 2022] PUT /identity/v3/projects/38239f821749434fa263d786b9dcdb4a/users/075280c62bc7465989ce8a5f88c41db1/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:27.508847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0cd7-7310-40fc-b33b-9e5b6b64e451 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.521649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0cd7-7310-40fc-b33b-9e5b6b64e451 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.564060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:27.579600 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f7b37-6357-4075-9058-5f6da7e25b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.580271 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f7b37-6357-4075-9058-5f6da7e25b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.580558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f7b37-6357-4075-9058-5f6da7e25b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.580834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f7b37-6357-4075-9058-5f6da7e25b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.581560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f7b37-6357-4075-9058-5f6da7e25b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.583823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f7b37-6357-4075-9058-5f6da7e25b42 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.593562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1262/2501] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:27.597861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c1e51-7f3a-4e5c-806b-c7335d4ee25e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.608691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c1e51-7f3a-4e5c-806b-c7335d4ee25e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.613204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c47baf-8377-4da4-967b-4d508348c6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.614097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c47baf-8377-4da4-967b-4d508348c6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.614418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c47baf-8377-4da4-967b-4d508348c6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.614698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c47baf-8377-4da4-967b-4d508348c6e4 admin admin] PATH_INFO: `/v3/projects/38239f821749434fa263d786b9dcdb4a/users/075280c62bc7465989ce8a5f88c41db1/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.616625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c47baf-8377-4da4-967b-4d508348c6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38239f821749434fa263d786b9dcdb4a, user_id=075280c62bc7465989ce8a5f88c41db1, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.619547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c47baf-8377-4da4-967b-4d508348c6e4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.629685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1240/2502] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:27 2022] PUT /identity/v3/projects/38239f821749434fa263d786b9dcdb4a/users/075280c62bc7465989ce8a5f88c41db1/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:27.640141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aae31-1b4f-4777-b79e-8938d435e405 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.640433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aae31-1b4f-4777-b79e-8938d435e405 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.640714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aae31-1b4f-4777-b79e-8938d435e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.669259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dc5aae31-1b4f-4777-b79e-8938d435e405 None None] MFA Rules not processed for user `075280c62bc7465989ce8a5f88c41db1`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:27.670589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dc5aae31-1b4f-4777-b79e-8938d435e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:27.737330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1263/2503] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:27.749164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c47baf-8377-4da4-967b-4d508348c6e4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.750896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c0c47baf-8377-4da4-967b-4d508348c6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:27.806629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c47baf-8377-4da4-967b-4d508348c6e4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.810193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb0226-5b87-4bbc-96fa-c96d711ab630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.810856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb0226-5b87-4bbc-96fa-c96d711ab630 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.811141 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb0226-5b87-4bbc-96fa-c96d711ab630 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.811417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb0226-5b87-4bbc-96fa-c96d711ab630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.820955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb0226-5b87-4bbc-96fa-c96d711ab630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.822563 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb0226-5b87-4bbc-96fa-c96d711ab630 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.831757 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1241/2504] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:27.870914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aae31-1b4f-4777-b79e-8938d435e405 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:27.872377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dc5aae31-1b4f-4777-b79e-8938d435e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:27.885084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aae31-1b4f-4777-b79e-8938d435e405 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:27.888584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad864985-6109-48af-a823-f0e1e8e14011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:27.889222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad864985-6109-48af-a823-f0e1e8e14011 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:27.889505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad864985-6109-48af-a823-f0e1e8e14011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:27.889777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad864985-6109-48af-a823-f0e1e8e14011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:27.945951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad864985-6109-48af-a823-f0e1e8e14011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:27.947427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad864985-6109-48af-a823-f0e1e8e14011 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:27.956272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1264/2505] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:30.794108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb0226-5b87-4bbc-96fa-c96d711ab630 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:30.865922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb0226-5b87-4bbc-96fa-c96d711ab630 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:30.870723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:30.871616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:30.871911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:30.872683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] PATH_INFO: `/v3/users/e8ceb60d151041aeb72b56528b640748` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:30.873872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ceb60d151041aeb72b56528b640748)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:30.875844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:30.932825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:30.938539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ceb60d151041aeb72b56528b640748'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:30.939432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ceb60d151041aeb72b56528b640748'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:30.940493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ceb60d151041aeb72b56528b640748'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:30.952746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ceb60d151041aeb72b56528b640748'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:30.959506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ceb60d151041aeb72b56528b640748'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:30.972167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1242/2506] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:30 2022] DELETE /identity/v3/users/e8ceb60d151041aeb72b56528b640748 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:30.977363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e4e1-6541-450e-b53d-df125aea9826 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:30.977816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e4e1-6541-450e-b53d-df125aea9826 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:30.978050 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e4e1-6541-450e-b53d-df125aea9826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:30.995690 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-3357e4e1-6541-450e-b53d-df125aea9826 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:30.996881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3357e4e1-6541-450e-b53d-df125aea9826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:31.053870 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1265/2507] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:31.063489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:31.064873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:31.120960 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87aa73-5682-4c9d-ac8a-0d2655d130a9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:31.124656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f387a9a-50a8-4851-be6d-5d440855c744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:31.125294 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f387a9a-50a8-4851-be6d-5d440855c744 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:31.125609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f387a9a-50a8-4851-be6d-5d440855c744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:31.125883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f387a9a-50a8-4851-be6d-5d440855c744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:31.134894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f387a9a-50a8-4851-be6d-5d440855c744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:31.136314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f387a9a-50a8-4851-be6d-5d440855c744 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:31.145627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1243/2508] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:42:31.412023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357e4e1-6541-450e-b53d-df125aea9826 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:31.413535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-3357e4e1-6541-450e-b53d-df125aea9826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:31.426725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357e4e1-6541-450e-b53d-df125aea9826 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:31.431700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:31.432568 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:31.432864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:31.433131 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] PATH_INFO: `/v3/projects/ebee6ea455a841cc9d0e16a476b92110` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:31.434394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebee6ea455a841cc9d0e16a476b92110)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:31.436453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:31.438319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:31.487043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebee6ea455a841cc9d0e16a476b92110', 'request_id': 'req-786e1a33-cf2f-45f0-a411-c902ebebbcda'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:31.494687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebee6ea455a841cc9d0e16a476b92110', 'request_id': 'req-786e1a33-cf2f-45f0-a411-c902ebebbcda'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:31.500157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebee6ea455a841cc9d0e16a476b92110', 'request_id': 'req-786e1a33-cf2f-45f0-a411-c902ebebbcda'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:31.510819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] The token cache is being invalidate because project ebee6ea455a841cc9d0e16a476b92110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:31.511108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:31.511723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:31.513233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1266/2509] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:31 2022] DELETE /identity/v3/projects/ebee6ea455a841cc9d0e16a476b92110 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:31.517211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f387a9a-50a8-4851-be6d-5d440855c744 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:31.527610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f387a9a-50a8-4851-be6d-5d440855c744 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:31.583977 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:31.584784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:31.585071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:31.585349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] PATH_INFO: `/v3/users/2ba6022e4f9e428080363a5fbdbc4ea5` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:31.587855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba6022e4f9e428080363a5fbdbc4ea5)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:31.589797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:31.636491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba6022e4f9e428080363a5fbdbc4ea5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:31.637122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba6022e4f9e428080363a5fbdbc4ea5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:31.637744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba6022e4f9e428080363a5fbdbc4ea5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:31.648819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:31.649916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba6022e4f9e428080363a5fbdbc4ea5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:31.658329 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba6022e4f9e428080363a5fbdbc4ea5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:31.670405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1244/2510] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:31 2022] DELETE /identity/v3/users/2ba6022e4f9e428080363a5fbdbc4ea5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:31.948343 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:31.950035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:31.971460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e1a33-cf2f-45f0-a411-c902ebebbcda admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:32.037305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:32.038297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:32.038627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:32.038906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] PATH_INFO: `/v3/projects/5af534f5feda4385be4757bcea6853c9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:32.041224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af534f5feda4385be4757bcea6853c9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:32.043167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:32.095365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af534f5feda4385be4757bcea6853c9', 'request_id': 'req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.104249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af534f5feda4385be4757bcea6853c9', 'request_id': 'req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.110459 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af534f5feda4385be4757bcea6853c9', 'request_id': 'req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.123365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] The token cache is being invalidate because project 5af534f5feda4385be4757bcea6853c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:32.123696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.124412 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.126197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1267/2511] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:31 2022] DELETE /identity/v3/projects/5af534f5feda4385be4757bcea6853c9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:32.130968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:32.132493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:32.145405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d49c8-b3d7-4eaa-aa01-605c4b503e6f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:32.211074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:32.212077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:32.212519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:32.212900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] PATH_INFO: `/v3/users/075280c62bc7465989ce8a5f88c41db1` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:32.214570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=075280c62bc7465989ce8a5f88c41db1)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:32.216809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:32.267238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075280c62bc7465989ce8a5f88c41db1'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.268129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075280c62bc7465989ce8a5f88c41db1'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.268801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075280c62bc7465989ce8a5f88c41db1'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.284991 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075280c62bc7465989ce8a5f88c41db1'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.293581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-f867497e-06b6-40b0-b3ff-7c0a46072c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075280c62bc7465989ce8a5f88c41db1'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.308739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1245/2512] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:32 2022] DELETE /identity/v3/users/075280c62bc7465989ce8a5f88c41db1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:42:32.580866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:32.582326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:32.597535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8c4bd-bcb2-49d3-8b71-a2edf8530311 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:32.615672 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:32.656414 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:32.657195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:32.657482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:32.657760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] PATH_INFO: `/v3/projects/38239f821749434fa263d786b9dcdb4a` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:32.658957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38239f821749434fa263d786b9dcdb4a)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:32.661452 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:32.708583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38239f821749434fa263d786b9dcdb4a', 'request_id': 'req-0958ee83-7c79-48a8-a13f-5b1a0b429444'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.716134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38239f821749434fa263d786b9dcdb4a', 'request_id': 'req-0958ee83-7c79-48a8-a13f-5b1a0b429444'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.721962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38239f821749434fa263d786b9dcdb4a', 'request_id': 'req-0958ee83-7c79-48a8-a13f-5b1a0b429444'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.733779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] The token cache is being invalidate because project 38239f821749434fa263d786b9dcdb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:32.734069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.734715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0958ee83-7c79-48a8-a13f-5b1a0b429444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:32.736302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1268/2513] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:32 2022] DELETE /identity/v3/projects/38239f821749434fa263d786b9dcdb4a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:32.742252 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afbc56-44b9-4eec-abee-96379248d73c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:32.742572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afbc56-44b9-4eec-abee-96379248d73c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:32.742855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afbc56-44b9-4eec-abee-96379248d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:32.760025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-04afbc56-44b9-4eec-abee-96379248d73c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:32.761220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-04afbc56-44b9-4eec-abee-96379248d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:32.810991 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:32.820353 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1246/2514] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:32.828391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c577f-8016-487b-96cc-ba48de4be30c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:32.828703 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c577f-8016-487b-96cc-ba48de4be30c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:32.828981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c577f-8016-487b-96cc-ba48de4be30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:32.847149 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f08c577f-8016-487b-96cc-ba48de4be30c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:32.848886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f08c577f-8016-487b-96cc-ba48de4be30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:32.856659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1269/2515] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:32.860986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afbc56-44b9-4eec-abee-96379248d73c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:32.870928 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afbc56-44b9-4eec-abee-96379248d73c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:32.875455 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a22ba-3379-4d30-aad1-bd1bbb01e7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:32.876097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a22ba-3379-4d30-aad1-bd1bbb01e7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:32.876376 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a22ba-3379-4d30-aad1-bd1bbb01e7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:32.876651 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a22ba-3379-4d30-aad1-bd1bbb01e7e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:32.877374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a22ba-3379-4d30-aad1-bd1bbb01e7e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:32.877703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a22ba-3379-4d30-aad1-bd1bbb01e7e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:32.879355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a22ba-3379-4d30-aad1-bd1bbb01e7e1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:32.890953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1247/2516] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:42:32.895784 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c577f-8016-487b-96cc-ba48de4be30c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:32.904753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c577f-8016-487b-96cc-ba48de4be30c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:32.909353 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2065b66-6861-42e8-a4af-10dae0323522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:32.909929 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2065b66-6861-42e8-a4af-10dae0323522 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:32.910210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2065b66-6861-42e8-a4af-10dae0323522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:32.910518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2065b66-6861-42e8-a4af-10dae0323522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:32.911751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2065b66-6861-42e8-a4af-10dae0323522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:32.913637 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2065b66-6861-42e8-a4af-10dae0323522 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:32.938199 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1270/2517] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:32 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:42:32.942232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a22ba-3379-4d30-aad1-bd1bbb01e7e1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:32.952901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a22ba-3379-4d30-aad1-bd1bbb01e7e1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.012541 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf422c4-5968-455f-ba86-6b79341ac5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.013219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf422c4-5968-455f-ba86-6b79341ac5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.013508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf422c4-5968-455f-ba86-6b79341ac5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.013800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf422c4-5968-455f-ba86-6b79341ac5f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.014584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf422c4-5968-455f-ba86-6b79341ac5f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.016491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf422c4-5968-455f-ba86-6b79341ac5f9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.036914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1248/2518] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:32 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:33.041125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2065b66-6861-42e8-a4af-10dae0323522 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:33.051467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2065b66-6861-42e8-a4af-10dae0323522 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.056097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274e0f3-15cf-4fcd-88b1-dd526a614924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.056758 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e0f3-15cf-4fcd-88b1-dd526a614924 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.057042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e0f3-15cf-4fcd-88b1-dd526a614924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.057316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e0f3-15cf-4fcd-88b1-dd526a614924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.058036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274e0f3-15cf-4fcd-88b1-dd526a614924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.059651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274e0f3-15cf-4fcd-88b1-dd526a614924 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.070483 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1271/2519] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:33.074309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf422c4-5968-455f-ba86-6b79341ac5f9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:33.084831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf422c4-5968-455f-ba86-6b79341ac5f9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.089518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfee674-8809-4650-9ba1-dd25073ac4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.090161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfee674-8809-4650-9ba1-dd25073ac4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.090480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfee674-8809-4650-9ba1-dd25073ac4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.090828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfee674-8809-4650-9ba1-dd25073ac4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.091478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfee674-8809-4650-9ba1-dd25073ac4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.093079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfee674-8809-4650-9ba1-dd25073ac4f0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.103167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1249/2520] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:33.107104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274e0f3-15cf-4fcd-88b1-dd526a614924 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:33.117393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274e0f3-15cf-4fcd-88b1-dd526a614924 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.122265 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c90f6-ca7b-4c54-9b74-fa8720065bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.123157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c90f6-ca7b-4c54-9b74-fa8720065bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.123444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c90f6-ca7b-4c54-9b74-fa8720065bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.123814 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c90f6-ca7b-4c54-9b74-fa8720065bcb admin admin] PATH_INFO: `/v3/projects/b56e9cfd38b849f99f292798e47f02a0/users/36d07ec04d4548f6909eceb93d9cb080/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.139161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c90f6-ca7b-4c54-9b74-fa8720065bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56e9cfd38b849f99f292798e47f02a0, user_id=36d07ec04d4548f6909eceb93d9cb080, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.141910 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c90f6-ca7b-4c54-9b74-fa8720065bcb admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.154838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1272/2521] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:33 2022] PUT /identity/v3/projects/b56e9cfd38b849f99f292798e47f02a0/users/36d07ec04d4548f6909eceb93d9cb080/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:33.167185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d1a05-7aed-49ff-8506-aa9eb74cffab None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.167659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d1a05-7aed-49ff-8506-aa9eb74cffab None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.167659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d1a05-7aed-49ff-8506-aa9eb74cffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.193759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-664d1a05-7aed-49ff-8506-aa9eb74cffab None None] MFA Rules not processed for user `36d07ec04d4548f6909eceb93d9cb080`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:33.195057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-664d1a05-7aed-49ff-8506-aa9eb74cffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:33.260375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1250/2522] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:33.264728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c90f6-ca7b-4c54-9b74-fa8720065bcb admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:33.313139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:33.330274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c90f6-ca7b-4c54-9b74-fa8720065bcb admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.340187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79641-9c8d-4289-bc7a-1d20364a7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.341203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79641-9c8d-4289-bc7a-1d20364a7adf admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.341502 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79641-9c8d-4289-bc7a-1d20364a7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.341778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd79641-9c8d-4289-bc7a-1d20364a7adf admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.342526 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd79641-9c8d-4289-bc7a-1d20364a7adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.344437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd79641-9c8d-4289-bc7a-1d20364a7adf admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.374189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1273/2523] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:33 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:33.375378 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d1a05-7aed-49ff-8506-aa9eb74cffab None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:33.386463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d1a05-7aed-49ff-8506-aa9eb74cffab None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.443239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:33.453747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280d5b7-f886-4497-b6fb-ad56763f9849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.454572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d5b7-f886-4497-b6fb-ad56763f9849 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.454983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d5b7-f886-4497-b6fb-ad56763f9849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.455354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280d5b7-f886-4497-b6fb-ad56763f9849 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.456353 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280d5b7-f886-4497-b6fb-ad56763f9849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.458616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280d5b7-f886-4497-b6fb-ad56763f9849 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.477763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1251/2524] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:33 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:42:33.481863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79641-9c8d-4289-bc7a-1d20364a7adf admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:33.492541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd79641-9c8d-4289-bc7a-1d20364a7adf admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.499949 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1b41c-bfd3-49ea-8209-52bae84ade5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.500607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1b41c-bfd3-49ea-8209-52bae84ade5c admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.500891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1b41c-bfd3-49ea-8209-52bae84ade5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.501165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1b41c-bfd3-49ea-8209-52bae84ade5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.501886 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1b41c-bfd3-49ea-8209-52bae84ade5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.503687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1b41c-bfd3-49ea-8209-52bae84ade5c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.515261 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1274/2525] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:33.519598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280d5b7-f886-4497-b6fb-ad56763f9849 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:33.529668 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280d5b7-f886-4497-b6fb-ad56763f9849 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.534317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c51e40-cfff-43d2-be2a-8d23cef180ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.535216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c51e40-cfff-43d2-be2a-8d23cef180ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.535503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c51e40-cfff-43d2-be2a-8d23cef180ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.535784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c51e40-cfff-43d2-be2a-8d23cef180ed admin admin] PATH_INFO: `/v3/projects/086bf10cc6814d27a8e6a0ac2d013f2c/users/5baa6ec680964c37bc8caf8209d58edd/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.551998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c51e40-cfff-43d2-be2a-8d23cef180ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=086bf10cc6814d27a8e6a0ac2d013f2c, user_id=5baa6ec680964c37bc8caf8209d58edd, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.554664 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c51e40-cfff-43d2-be2a-8d23cef180ed admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.568918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1252/2526] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:33 2022] PUT /identity/v3/projects/086bf10cc6814d27a8e6a0ac2d013f2c/users/5baa6ec680964c37bc8caf8209d58edd/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:33.572932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1b41c-bfd3-49ea-8209-52bae84ade5c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:33.582973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1b41c-bfd3-49ea-8209-52bae84ade5c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.638163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e332f20-31ae-434c-b0b8-b31090f128d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.639006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e332f20-31ae-434c-b0b8-b31090f128d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.639336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e332f20-31ae-434c-b0b8-b31090f128d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.639617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e332f20-31ae-434c-b0b8-b31090f128d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.640365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e332f20-31ae-434c-b0b8-b31090f128d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.641960 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e332f20-31ae-434c-b0b8-b31090f128d3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.651704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1275/2527] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:33.656034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c51e40-cfff-43d2-be2a-8d23cef180ed admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:33.666219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c51e40-cfff-43d2-be2a-8d23cef180ed admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.670836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51b62b-6aba-4d53-8e7a-5b53f697ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.671704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51b62b-6aba-4d53-8e7a-5b53f697ee6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.672016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51b62b-6aba-4d53-8e7a-5b53f697ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.672291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51b62b-6aba-4d53-8e7a-5b53f697ee6d admin admin] PATH_INFO: `/v3/projects/086bf10cc6814d27a8e6a0ac2d013f2c/users/5baa6ec680964c37bc8caf8209d58edd/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.674251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51b62b-6aba-4d53-8e7a-5b53f697ee6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=086bf10cc6814d27a8e6a0ac2d013f2c, user_id=5baa6ec680964c37bc8caf8209d58edd, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.677390 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51b62b-6aba-4d53-8e7a-5b53f697ee6d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.687443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1253/2528] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:33 2022] PUT /identity/v3/projects/086bf10cc6814d27a8e6a0ac2d013f2c/users/5baa6ec680964c37bc8caf8209d58edd/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:33.698101 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaedae3-c18e-4f1b-bf9c-430e306170f6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.698330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaedae3-c18e-4f1b-bf9c-430e306170f6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.698638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaedae3-c18e-4f1b-bf9c-430e306170f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.724068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-7aaedae3-c18e-4f1b-bf9c-430e306170f6 None None] MFA Rules not processed for user `5baa6ec680964c37bc8caf8209d58edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:33.725297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-7aaedae3-c18e-4f1b-bf9c-430e306170f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:33.792887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1276/2529] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:33.804418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51b62b-6aba-4d53-8e7a-5b53f697ee6d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:33.806091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5d51b62b-6aba-4d53-8e7a-5b53f697ee6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:33.861063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51b62b-6aba-4d53-8e7a-5b53f697ee6d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:33.865263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715cab9-9a98-4bac-a26e-be57e6ebd7a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:33.865895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715cab9-9a98-4bac-a26e-be57e6ebd7a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:33.866180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715cab9-9a98-4bac-a26e-be57e6ebd7a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:33.866490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715cab9-9a98-4bac-a26e-be57e6ebd7a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:33.875917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715cab9-9a98-4bac-a26e-be57e6ebd7a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:33.877345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715cab9-9a98-4bac-a26e-be57e6ebd7a1 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:33.886977 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1254/2530] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:34.409362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaedae3-c18e-4f1b-bf9c-430e306170f6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:34.459920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:34.480016 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaedae3-c18e-4f1b-bf9c-430e306170f6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:34.484544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:34.485433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:34.485713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:34.485992 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] PATH_INFO: `/v3/users/36d07ec04d4548f6909eceb93d9cb080` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:34.487267 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d07ec04d4548f6909eceb93d9cb080)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:34.489234 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:34.538053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d07ec04d4548f6909eceb93d9cb080'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:34.538701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d07ec04d4548f6909eceb93d9cb080'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:34.546233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d07ec04d4548f6909eceb93d9cb080'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:34.558813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d07ec04d4548f6909eceb93d9cb080'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:34.565897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d07ec04d4548f6909eceb93d9cb080'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:34.572519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1277/2531] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:34 2022] DELETE /identity/v3/users/36d07ec04d4548f6909eceb93d9cb080 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:34.578435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4ebef-f312-4adc-a187-0c1fde9d2ca6 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:34.578876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4ebef-f312-4adc-a187-0c1fde9d2ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:34.578976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4ebef-f312-4adc-a187-0c1fde9d2ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:34.597602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7ba4ebef-f312-4adc-a187-0c1fde9d2ca6 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:34.598847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7ba4ebef-f312-4adc-a187-0c1fde9d2ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:34.658399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1255/2532] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:34.668705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:34.669545 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:34.728263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e17ed-3133-4967-a181-fcd2315c63e9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:34.731954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6f3f4-2571-412d-847b-526a8a6decb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:34.732539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6f3f4-2571-412d-847b-526a8a6decb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:34.732824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6f3f4-2571-412d-847b-526a8a6decb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:34.733129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6f3f4-2571-412d-847b-526a8a6decb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:34.743125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6f3f4-2571-412d-847b-526a8a6decb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:34.744995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6f3f4-2571-412d-847b-526a8a6decb4 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:34.755422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1278/2533] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:35.033819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4ebef-f312-4adc-a187-0c1fde9d2ca6 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:35.036336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7ba4ebef-f312-4adc-a187-0c1fde9d2ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:35.048718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4ebef-f312-4adc-a187-0c1fde9d2ca6 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:35.053648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:35.054536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:35.054818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:35.055095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] PATH_INFO: `/v3/projects/b56e9cfd38b849f99f292798e47f02a0` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:35.056262 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56e9cfd38b849f99f292798e47f02a0)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:35.058147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:35.102627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:35.105874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56e9cfd38b849f99f292798e47f02a0', 'request_id': 'req-217a19be-b477-4c05-aa39-f3f52194aee0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.112350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56e9cfd38b849f99f292798e47f02a0', 'request_id': 'req-217a19be-b477-4c05-aa39-f3f52194aee0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.118695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56e9cfd38b849f99f292798e47f02a0', 'request_id': 'req-217a19be-b477-4c05-aa39-f3f52194aee0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.130507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] The token cache is being invalidate because project b56e9cfd38b849f99f292798e47f02a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:35.130794 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.131407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.132917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1256/2534] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:35 2022] DELETE /identity/v3/projects/b56e9cfd38b849f99f292798e47f02a0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:35.137109 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6f3f4-2571-412d-847b-526a8a6decb4 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:35.147406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6f3f4-2571-412d-847b-526a8a6decb4 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:35.202873 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:35.203736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:35.204046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:35.204323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] PATH_INFO: `/v3/users/5baa6ec680964c37bc8caf8209d58edd` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:35.205640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5baa6ec680964c37bc8caf8209d58edd)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:35.208121 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:35.212774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:35.256155 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5baa6ec680964c37bc8caf8209d58edd'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.256789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5baa6ec680964c37bc8caf8209d58edd'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.263641 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5baa6ec680964c37bc8caf8209d58edd'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.275911 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5baa6ec680964c37bc8caf8209d58edd'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.282779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2e847f30-7049-430b-90ff-9eba40a3d42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5baa6ec680964c37bc8caf8209d58edd'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.289278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1279/2535] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:35 2022] DELETE /identity/v3/users/5baa6ec680964c37bc8caf8209d58edd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:35.566201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:35.566201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:35.587498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a19be-b477-4c05-aa39-f3f52194aee0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:35.648190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:35.649068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:35.649350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:35.649624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] PATH_INFO: `/v3/projects/086bf10cc6814d27a8e6a0ac2d013f2c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:35.650850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086bf10cc6814d27a8e6a0ac2d013f2c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:35.652772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:35.699632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086bf10cc6814d27a8e6a0ac2d013f2c', 'request_id': 'req-bd2fe083-9ae3-4670-98ab-413510c51c50'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.705465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086bf10cc6814d27a8e6a0ac2d013f2c', 'request_id': 'req-bd2fe083-9ae3-4670-98ab-413510c51c50'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.711731 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086bf10cc6814d27a8e6a0ac2d013f2c', 'request_id': 'req-bd2fe083-9ae3-4670-98ab-413510c51c50'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.724003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] The token cache is being invalidate because project 086bf10cc6814d27a8e6a0ac2d013f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:35.724293 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.724945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bd2fe083-9ae3-4670-98ab-413510c51c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:35.726522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1257/2536] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:35 2022] DELETE /identity/v3/projects/086bf10cc6814d27a8e6a0ac2d013f2c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:35.731509 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756823-a056-424e-88af-cfab14b4431b None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:35.732013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756823-a056-424e-88af-cfab14b4431b None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:35.732243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756823-a056-424e-88af-cfab14b4431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:35.750486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-de756823-a056-424e-88af-cfab14b4431b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:35.751683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-de756823-a056-424e-88af-cfab14b4431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:35.811032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1280/2537] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:35.819348 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e238-3e00-4349-84ef-8ee1e65fa5f8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:35.819644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e238-3e00-4349-84ef-8ee1e65fa5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:35.819930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7e238-3e00-4349-84ef-8ee1e65fa5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:35.837882 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-25a7e238-3e00-4349-84ef-8ee1e65fa5f8 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:35.839133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-25a7e238-3e00-4349-84ef-8ee1e65fa5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:35.847051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1258/2538] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:35.851157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de756823-a056-424e-88af-cfab14b4431b None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:35.860893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de756823-a056-424e-88af-cfab14b4431b None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:35.866019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed91570-c466-459a-8812-26060827b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:35.866689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed91570-c466-459a-8812-26060827b715 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:35.866971 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed91570-c466-459a-8812-26060827b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:35.867243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed91570-c466-459a-8812-26060827b715 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:35.868007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed91570-c466-459a-8812-26060827b715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:35.868563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed91570-c466-459a-8812-26060827b715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:35.870169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed91570-c466-459a-8812-26060827b715 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:35.882108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1281/2539] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:42:35.886186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e238-3e00-4349-84ef-8ee1e65fa5f8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:35.895395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7e238-3e00-4349-84ef-8ee1e65fa5f8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:35.900234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d08a2-9671-47db-9870-74797a266d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:35.900878 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d08a2-9671-47db-9870-74797a266d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:35.901169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d08a2-9671-47db-9870-74797a266d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:35.901446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d08a2-9671-47db-9870-74797a266d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:35.902132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d08a2-9671-47db-9870-74797a266d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:35.904058 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d08a2-9671-47db-9870-74797a266d80 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:35.938205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1259/2540] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:35 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:35.939293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed91570-c466-459a-8812-26060827b715 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:35.950398 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed91570-c466-459a-8812-26060827b715 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:36.007682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5336aa-f084-4186-95d6-1fd1f8b64593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:36.008358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5336aa-f084-4186-95d6-1fd1f8b64593 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:36.008645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5336aa-f084-4186-95d6-1fd1f8b64593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:36.008922 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5336aa-f084-4186-95d6-1fd1f8b64593 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:36.009618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5336aa-f084-4186-95d6-1fd1f8b64593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:36.011548 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5336aa-f084-4186-95d6-1fd1f8b64593 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:36.028089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:36.038533 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1282/2541] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:35 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:42:36.039044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d08a2-9671-47db-9870-74797a266d80 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:36.049592 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d08a2-9671-47db-9870-74797a266d80 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:36.055025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fc737-64b1-4b70-baa3-d254bf49ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:36.055689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc737-64b1-4b70-baa3-d254bf49ef26 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:36.055976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc737-64b1-4b70-baa3-d254bf49ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:36.056256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc737-64b1-4b70-baa3-d254bf49ef26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:36.056983 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fc737-64b1-4b70-baa3-d254bf49ef26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:36.058595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fc737-64b1-4b70-baa3-d254bf49ef26 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:36.072051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1260/2542] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:42:36.073161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5336aa-f084-4186-95d6-1fd1f8b64593 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:36.083336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5336aa-f084-4186-95d6-1fd1f8b64593 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:36.088566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ac64d-f91b-4593-9a95-a84ba92eae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:36.089294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ac64d-f91b-4593-9a95-a84ba92eae86 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:36.089577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ac64d-f91b-4593-9a95-a84ba92eae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:36.089853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ac64d-f91b-4593-9a95-a84ba92eae86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:36.090612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ac64d-f91b-4593-9a95-a84ba92eae86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:36.092262 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ac64d-f91b-4593-9a95-a84ba92eae86 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:36.103551 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1283/2543] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:42:36.107898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fc737-64b1-4b70-baa3-d254bf49ef26 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:36.119602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fc737-64b1-4b70-baa3-d254bf49ef26 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:36.125526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83916c1-b6ca-4b01-ab00-bb5ec8fa760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:36.126574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83916c1-b6ca-4b01-ab00-bb5ec8fa760c admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:36.126907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83916c1-b6ca-4b01-ab00-bb5ec8fa760c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:36.127194 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83916c1-b6ca-4b01-ab00-bb5ec8fa760c admin admin] PATH_INFO: `/v3/projects/7a6311a3ff2643919e1df8826fd5c105/users/28a4ad50e45e4bddaf5ded63ec6654d3/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:36.144629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83916c1-b6ca-4b01-ab00-bb5ec8fa760c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6311a3ff2643919e1df8826fd5c105, user_id=28a4ad50e45e4bddaf5ded63ec6654d3, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:36.147506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83916c1-b6ca-4b01-ab00-bb5ec8fa760c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:36.157285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:36.163720 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1261/2544] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:36 2022] PUT /identity/v3/projects/7a6311a3ff2643919e1df8826fd5c105/users/28a4ad50e45e4bddaf5ded63ec6654d3/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:36.173915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bba19-0fdb-4458-a8f4-7266ddbbec58 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:36.174203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bba19-0fdb-4458-a8f4-7266ddbbec58 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:36.174510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bba19-0fdb-4458-a8f4-7266ddbbec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:36.202058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5e1bba19-0fdb-4458-a8f4-7266ddbbec58 None None] MFA Rules not processed for user `28a4ad50e45e4bddaf5ded63ec6654d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:36.203300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5e1bba19-0fdb-4458-a8f4-7266ddbbec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:36.269554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1284/2545] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:36.280477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83916c1-b6ca-4b01-ab00-bb5ec8fa760c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:36.282752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e83916c1-b6ca-4b01-ab00-bb5ec8fa760c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:36.341356 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83916c1-b6ca-4b01-ab00-bb5ec8fa760c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:36.344958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ad8ce-b8b7-47a9-a75b-cce75f8c10c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:36.345603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad8ce-b8b7-47a9-a75b-cce75f8c10c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:36.345889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad8ce-b8b7-47a9-a75b-cce75f8c10c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:36.346170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad8ce-b8b7-47a9-a75b-cce75f8c10c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:36.355640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ad8ce-b8b7-47a9-a75b-cce75f8c10c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:36.357057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ad8ce-b8b7-47a9-a75b-cce75f8c10c9 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:36.366319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1262/2546] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:42:39.333189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bba19-0fdb-4458-a8f4-7266ddbbec58 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:39.422069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bba19-0fdb-4458-a8f4-7266ddbbec58 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:39.427603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:39.428484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:39.428771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:39.429691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] PATH_INFO: `/v3/users/28a4ad50e45e4bddaf5ded63ec6654d3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:39.430925 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a4ad50e45e4bddaf5ded63ec6654d3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:39.432900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:39.481111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a4ad50e45e4bddaf5ded63ec6654d3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:39.482051 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a4ad50e45e4bddaf5ded63ec6654d3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:39.489928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a4ad50e45e4bddaf5ded63ec6654d3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:39.502601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a4ad50e45e4bddaf5ded63ec6654d3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:39.510159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a4ad50e45e4bddaf5ded63ec6654d3'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:39.511947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:39.517829 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1285/2547] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:39 2022] DELETE /identity/v3/users/28a4ad50e45e4bddaf5ded63ec6654d3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:39.522337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4a085-1941-4787-a359-52b1a62eb225 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:39.522836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4a085-1941-4787-a359-52b1a62eb225 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:39.523272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4a085-1941-4787-a359-52b1a62eb225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:39.540531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-79f4a085-1941-4787-a359-52b1a62eb225 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:39.541841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-79f4a085-1941-4787-a359-52b1a62eb225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:39.606239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1263/2548] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:39.616595 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:39.618056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:39.687748 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f919ee-9e30-4ad9-b965-ad6cfde73733 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:39.692338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bd359-1cf1-4f3b-b437-f25466addfa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:39.693009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bd359-1cf1-4f3b-b437-f25466addfa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:39.693298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bd359-1cf1-4f3b-b437-f25466addfa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:39.693578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bd359-1cf1-4f3b-b437-f25466addfa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:39.703997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bd359-1cf1-4f3b-b437-f25466addfa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:39.705732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bd359-1cf1-4f3b-b437-f25466addfa6 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:39.718861 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1286/2549] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:40.110478 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4a085-1941-4787-a359-52b1a62eb225 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:40.111974 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-79f4a085-1941-4787-a359-52b1a62eb225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:40.126538 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4a085-1941-4787-a359-52b1a62eb225 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:40.131617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:40.132774 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.133260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.133608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] PATH_INFO: `/v3/projects/7a6311a3ff2643919e1df8826fd5c105` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.135185 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6311a3ff2643919e1df8826fd5c105)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:40.137278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:40.189122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6311a3ff2643919e1df8826fd5c105', 'request_id': 'req-00030c11-3b08-484a-8402-bae3eed59ee1'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:40.195162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6311a3ff2643919e1df8826fd5c105', 'request_id': 'req-00030c11-3b08-484a-8402-bae3eed59ee1'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:40.201490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6311a3ff2643919e1df8826fd5c105', 'request_id': 'req-00030c11-3b08-484a-8402-bae3eed59ee1'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:40.215765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] The token cache is being invalidate because project 7a6311a3ff2643919e1df8826fd5c105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:40.216045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:40.216693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-00030c11-3b08-484a-8402-bae3eed59ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:40.218236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1264/2550] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:40 2022] DELETE /identity/v3/projects/7a6311a3ff2643919e1df8826fd5c105 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:40.223895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37465b-5d5b-4428-bae2-20d43f88cb33 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.224181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37465b-5d5b-4428-bae2-20d43f88cb33 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.224484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37465b-5d5b-4428-bae2-20d43f88cb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.243264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6e37465b-5d5b-4428-bae2-20d43f88cb33 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:40.245730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6e37465b-5d5b-4428-bae2-20d43f88cb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:40.316779 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1287/2551] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:42:40.324739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc91f4d-3117-4192-b388-cadbe0864747 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.325029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc91f4d-3117-4192-b388-cadbe0864747 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.325305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc91f4d-3117-4192-b388-cadbe0864747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.345566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5cc91f4d-3117-4192-b388-cadbe0864747 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:40.346845 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5cc91f4d-3117-4192-b388-cadbe0864747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:40.355333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1265/2552] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:40.359762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37465b-5d5b-4428-bae2-20d43f88cb33 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:40.370320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37465b-5d5b-4428-bae2-20d43f88cb33 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:40.375139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356ec22-b9fe-4ec2-98bb-0ca4b61b48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:40.375806 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356ec22-b9fe-4ec2-98bb-0ca4b61b48e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.376096 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356ec22-b9fe-4ec2-98bb-0ca4b61b48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.376377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356ec22-b9fe-4ec2-98bb-0ca4b61b48e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.377148 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356ec22-b9fe-4ec2-98bb-0ca4b61b48e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:40.377458 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356ec22-b9fe-4ec2-98bb-0ca4b61b48e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:40.379104 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356ec22-b9fe-4ec2-98bb-0ca4b61b48e5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:40.392445 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1288/2553] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:40.397218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc91f4d-3117-4192-b388-cadbe0864747 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:40.406762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc91f4d-3117-4192-b388-cadbe0864747 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:40.412422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3527e1-7965-4fea-9f81-4c034ae423a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:40.412733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3527e1-7965-4fea-9f81-4c034ae423a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.413020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3527e1-7965-4fea-9f81-4c034ae423a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.413302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3527e1-7965-4fea-9f81-4c034ae423a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.413996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3527e1-7965-4fea-9f81-4c034ae423a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:40.415940 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3527e1-7965-4fea-9f81-4c034ae423a3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:40.437138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:40.449615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1266/2554] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:40 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:42:40.450930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356ec22-b9fe-4ec2-98bb-0ca4b61b48e5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:40.461522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356ec22-b9fe-4ec2-98bb-0ca4b61b48e5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:40.522844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a51161-0d44-468d-a9be-72947b33214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:40.523518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a51161-0d44-468d-a9be-72947b33214d admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.523809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a51161-0d44-468d-a9be-72947b33214d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.524182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a51161-0d44-468d-a9be-72947b33214d admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.524866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a51161-0d44-468d-a9be-72947b33214d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:40.526934 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a51161-0d44-468d-a9be-72947b33214d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:40.551290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1289/2555] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:40 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:40.552544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3527e1-7965-4fea-9f81-4c034ae423a3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:40.563730 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3527e1-7965-4fea-9f81-4c034ae423a3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:40.570153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361e102-10c4-4f30-8cd9-cbf6af17f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:40.570856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361e102-10c4-4f30-8cd9-cbf6af17f4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.571139 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361e102-10c4-4f30-8cd9-cbf6af17f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.571413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361e102-10c4-4f30-8cd9-cbf6af17f4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.572136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361e102-10c4-4f30-8cd9-cbf6af17f4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:40.573786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361e102-10c4-4f30-8cd9-cbf6af17f4c1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:40.585003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1267/2556] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:40.589195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a51161-0d44-468d-a9be-72947b33214d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:40.602563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a51161-0d44-468d-a9be-72947b33214d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:40.607531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac31633-c4b3-47c8-a640-1c1b068d1c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:40.608564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31633-c4b3-47c8-a640-1c1b068d1c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.608847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31633-c4b3-47c8-a640-1c1b068d1c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.609125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31633-c4b3-47c8-a640-1c1b068d1c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.609847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac31633-c4b3-47c8-a640-1c1b068d1c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:40.611616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac31633-c4b3-47c8-a640-1c1b068d1c09 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:40.623388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1290/2557] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:40.628371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361e102-10c4-4f30-8cd9-cbf6af17f4c1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:40.638309 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361e102-10c4-4f30-8cd9-cbf6af17f4c1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:40.642930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bac9fd-9568-4558-bc3f-72a31c1aace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:40.643798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac9fd-9568-4558-bc3f-72a31c1aace0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.644072 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac9fd-9568-4558-bc3f-72a31c1aace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.644344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac9fd-9568-4558-bc3f-72a31c1aace0 admin admin] PATH_INFO: `/v3/projects/59c1bc0eaecd49de9ff33d26aee7625d/users/9e3d207edc24461bbe303ff037e440fa/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.659498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bac9fd-9568-4558-bc3f-72a31c1aace0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c1bc0eaecd49de9ff33d26aee7625d, user_id=9e3d207edc24461bbe303ff037e440fa, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:40.662716 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bac9fd-9568-4558-bc3f-72a31c1aace0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:40.675149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1268/2558] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:40 2022] PUT /identity/v3/projects/59c1bc0eaecd49de9ff33d26aee7625d/users/9e3d207edc24461bbe303ff037e440fa/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:40.687016 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528346d-dfd8-44b1-8909-40fb66949e66 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.687322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528346d-dfd8-44b1-8909-40fb66949e66 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.687601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528346d-dfd8-44b1-8909-40fb66949e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.700353 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:40.715654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-d528346d-dfd8-44b1-8909-40fb66949e66 None None] MFA Rules not processed for user `9e3d207edc24461bbe303ff037e440fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:40.716890 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d528346d-dfd8-44b1-8909-40fb66949e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:40.782140 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1291/2559] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:40.794700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bac9fd-9568-4558-bc3f-72a31c1aace0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:40.796441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-40bac9fd-9568-4558-bc3f-72a31c1aace0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:40.852476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bac9fd-9568-4558-bc3f-72a31c1aace0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:40.856147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740f93b-e8ec-4421-a1bb-1a23820749a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe27c3402a741f0a80d87ae6ecd3f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:40.856935 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740f93b-e8ec-4421-a1bb-1a23820749a3 service glance] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:40.857225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740f93b-e8ec-4421-a1bb-1a23820749a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:40.857504 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740f93b-e8ec-4421-a1bb-1a23820749a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:40.866269 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740f93b-e8ec-4421-a1bb-1a23820749a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:40.867727 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740f93b-e8ec-4421-a1bb-1a23820749a3 service glance] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:40.876696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1269/2560] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:44.118020 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528346d-dfd8-44b1-8909-40fb66949e66 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:44.119725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d528346d-dfd8-44b1-8909-40fb66949e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:44.178958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528346d-dfd8-44b1-8909-40fb66949e66 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:44.182442 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bb660-4ee2-42d5-81b8-49f32e3832da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:44.183191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bb660-4ee2-42d5-81b8-49f32e3832da service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:44.183492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bb660-4ee2-42d5-81b8-49f32e3832da service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:44.183858 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bb660-4ee2-42d5-81b8-49f32e3832da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:44.185986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-358bb660-4ee2-42d5-81b8-49f32e3832da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:44.250112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bb660-4ee2-42d5-81b8-49f32e3832da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:44.251617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bb660-4ee2-42d5-81b8-49f32e3832da service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:44.262266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1292/2561] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:47.464239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740f93b-e8ec-4421-a1bb-1a23820749a3 service glance] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:47.465729 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d740f93b-e8ec-4421-a1bb-1a23820749a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:47.480180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740f93b-e8ec-4421-a1bb-1a23820749a3 service glance] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:47.485036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:47.485919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:47.486284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:47.486589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] PATH_INFO: `/v3/users/6ca2454700fa46dbbfe0fe44bcbc266c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:47.501235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca2454700fa46dbbfe0fe44bcbc266c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:47.503207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:47.549740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca2454700fa46dbbfe0fe44bcbc266c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:47.550406 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca2454700fa46dbbfe0fe44bcbc266c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:47.551033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca2454700fa46dbbfe0fe44bcbc266c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:47.570024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca2454700fa46dbbfe0fe44bcbc266c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:47.582104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8d271020-17aa-42bc-997c-46141fc4d79d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca2454700fa46dbbfe0fe44bcbc266c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:47.598292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1270/2562] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:47 2022] DELETE /identity/v3/users/6ca2454700fa46dbbfe0fe44bcbc266c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:47.774996 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bb660-4ee2-42d5-81b8-49f32e3832da service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:47.786118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bb660-4ee2-42d5-81b8-49f32e3832da service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:47.855710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:47.873851 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:47.874769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:47.875054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:47.875330 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] PATH_INFO: `/v3/projects/e01d0638282643e9bda4272799551fb9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:47.887572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01d0638282643e9bda4272799551fb9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:47.889481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:47.940697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01d0638282643e9bda4272799551fb9', 'request_id': 'req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:47.951122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01d0638282643e9bda4272799551fb9', 'request_id': 'req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:47.957120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01d0638282643e9bda4272799551fb9', 'request_id': 'req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:47.973975 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] The token cache is being invalidate because project e01d0638282643e9bda4272799551fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:47.974264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:47.974950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-49ac5334-b78d-4e22-8a6b-01f9c55efa5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:47.976469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1293/2563] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:47 2022] DELETE /identity/v3/projects/e01d0638282643e9bda4272799551fb9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:47.981296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4f1c-56d3-4f44-a41b-7b3de43014ea None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:47.981587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4f1c-56d3-4f44-a41b-7b3de43014ea None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:47.981867 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4f1c-56d3-4f44-a41b-7b3de43014ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:47.999621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f39b4f1c-56d3-4f44-a41b-7b3de43014ea None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:48.000809 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f39b4f1c-56d3-4f44-a41b-7b3de43014ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:48.022343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:48.062195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1271/2564] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:48.070483 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed187-f8c9-4a2e-97c3-f39a04e5e413 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.070785 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed187-f8c9-4a2e-97c3-f39a04e5e413 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.071072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed187-f8c9-4a2e-97c3-f39a04e5e413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.088987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c0bed187-f8c9-4a2e-97c3-f39a04e5e413 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:48.090221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c0bed187-f8c9-4a2e-97c3-f39a04e5e413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:48.098812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1294/2565] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:48.103106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b4f1c-56d3-4f44-a41b-7b3de43014ea None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.114438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b4f1c-56d3-4f44-a41b-7b3de43014ea None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.119183 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf30fd-d1e9-4605-b802-a59092ffcbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.119825 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf30fd-d1e9-4605-b802-a59092ffcbab admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.120105 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf30fd-d1e9-4605-b802-a59092ffcbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.120376 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf30fd-d1e9-4605-b802-a59092ffcbab admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.121087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf30fd-d1e9-4605-b802-a59092ffcbab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:48.121388 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf30fd-d1e9-4605-b802-a59092ffcbab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.123016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf30fd-d1e9-4605-b802-a59092ffcbab admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.135864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1272/2566] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:48.140260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed187-f8c9-4a2e-97c3-f39a04e5e413 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.149473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed187-f8c9-4a2e-97c3-f39a04e5e413 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.154199 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de9fec-bdaa-4ddb-aa1d-03950127b858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.155117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de9fec-bdaa-4ddb-aa1d-03950127b858 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.155401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de9fec-bdaa-4ddb-aa1d-03950127b858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.155676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de9fec-bdaa-4ddb-aa1d-03950127b858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.156354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de9fec-bdaa-4ddb-aa1d-03950127b858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.158249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de9fec-bdaa-4ddb-aa1d-03950127b858 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.185743 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1295/2567] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:48 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:48.190166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf30fd-d1e9-4605-b802-a59092ffcbab admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.200041 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf30fd-d1e9-4605-b802-a59092ffcbab admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.258146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582316-5a8a-4d7c-b44e-b06bec6c94c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.258869 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582316-5a8a-4d7c-b44e-b06bec6c94c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.259158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582316-5a8a-4d7c-b44e-b06bec6c94c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.259436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582316-5a8a-4d7c-b44e-b06bec6c94c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.260142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582316-5a8a-4d7c-b44e-b06bec6c94c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.262037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582316-5a8a-4d7c-b44e-b06bec6c94c8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.281132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1273/2568] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:48 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:48.285775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de9fec-bdaa-4ddb-aa1d-03950127b858 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.296307 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de9fec-bdaa-4ddb-aa1d-03950127b858 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.300986 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0a5ce-94ef-485b-8112-f14dc695e5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.302154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a5ce-94ef-485b-8112-f14dc695e5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.302481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a5ce-94ef-485b-8112-f14dc695e5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.302761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a5ce-94ef-485b-8112-f14dc695e5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.303486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0a5ce-94ef-485b-8112-f14dc695e5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.305103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0a5ce-94ef-485b-8112-f14dc695e5f9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.318578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1296/2569] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:42:48.319798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582316-5a8a-4d7c-b44e-b06bec6c94c8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.330213 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582316-5a8a-4d7c-b44e-b06bec6c94c8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.336556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a3780-ff06-45ad-949c-6f2e3ccd7c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.337877 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3780-ff06-45ad-949c-6f2e3ccd7c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.338161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3780-ff06-45ad-949c-6f2e3ccd7c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.339522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a3780-ff06-45ad-949c-6f2e3ccd7c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.340278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a3780-ff06-45ad-949c-6f2e3ccd7c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.341964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a3780-ff06-45ad-949c-6f2e3ccd7c16 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.353636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1274/2570] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:42:48.357950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0a5ce-94ef-485b-8112-f14dc695e5f9 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.369319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0a5ce-94ef-485b-8112-f14dc695e5f9 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.374433 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2fa93-9b6d-4929-bb15-24878574daae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.375347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2fa93-9b6d-4929-bb15-24878574daae admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.375630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2fa93-9b6d-4929-bb15-24878574daae admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.375991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2fa93-9b6d-4929-bb15-24878574daae admin admin] PATH_INFO: `/v3/projects/ef2371ec213249d4bc7b32fa2f42ec14/users/ba2af386caf44335a0d33d9df4151847/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.390766 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2fa93-9b6d-4929-bb15-24878574daae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2371ec213249d4bc7b32fa2f42ec14, user_id=ba2af386caf44335a0d33d9df4151847, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.393403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2fa93-9b6d-4929-bb15-24878574daae admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.406038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1297/2571] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:48 2022] PUT /identity/v3/projects/ef2371ec213249d4bc7b32fa2f42ec14/users/ba2af386caf44335a0d33d9df4151847/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:48.417073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244901-4ff5-46b5-8eec-034356058291 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.417367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244901-4ff5-46b5-8eec-034356058291 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.417648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244901-4ff5-46b5-8eec-034356058291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.445318 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-7b244901-4ff5-46b5-8eec-034356058291 None None] MFA Rules not processed for user `ba2af386caf44335a0d33d9df4151847`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:48.448064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7b244901-4ff5-46b5-8eec-034356058291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:48.512119 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1275/2572] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:48.516856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2fa93-9b6d-4929-bb15-24878574daae admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.583554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2fa93-9b6d-4929-bb15-24878574daae admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.589011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bcf05-ad6a-4d93-92f6-e98f38db36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.589679 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bcf05-ad6a-4d93-92f6-e98f38db36eb admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.589967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bcf05-ad6a-4d93-92f6-e98f38db36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.590246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bcf05-ad6a-4d93-92f6-e98f38db36eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.590998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bcf05-ad6a-4d93-92f6-e98f38db36eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.592933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bcf05-ad6a-4d93-92f6-e98f38db36eb admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.602417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:48.627306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1298/2573] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:48 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:48.634810 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b244901-4ff5-46b5-8eec-034356058291 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.647945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b244901-4ff5-46b5-8eec-034356058291 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.669657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:48.721335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848fe4a-40da-4d04-881a-67bc4b4117ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.722113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848fe4a-40da-4d04-881a-67bc4b4117ab admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.722502 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848fe4a-40da-4d04-881a-67bc4b4117ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.722881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848fe4a-40da-4d04-881a-67bc4b4117ab admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.723640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848fe4a-40da-4d04-881a-67bc4b4117ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.725644 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848fe4a-40da-4d04-881a-67bc4b4117ab admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.747853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1276/2574] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:48 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:48.751913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bcf05-ad6a-4d93-92f6-e98f38db36eb admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.763308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bcf05-ad6a-4d93-92f6-e98f38db36eb admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.768498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339eef3-d646-4520-a501-1f7131e2fe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.769164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339eef3-d646-4520-a501-1f7131e2fe82 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.769575 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339eef3-d646-4520-a501-1f7131e2fe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.769885 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339eef3-d646-4520-a501-1f7131e2fe82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.770643 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339eef3-d646-4520-a501-1f7131e2fe82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.772268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339eef3-d646-4520-a501-1f7131e2fe82 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.787216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1299/2575] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:48.791104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848fe4a-40da-4d04-881a-67bc4b4117ab admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.801861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848fe4a-40da-4d04-881a-67bc4b4117ab admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.808449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7b0f8-4150-492b-bc76-cdd73ef646a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.809544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7b0f8-4150-492b-bc76-cdd73ef646a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.809851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7b0f8-4150-492b-bc76-cdd73ef646a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.810155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7b0f8-4150-492b-bc76-cdd73ef646a8 admin admin] PATH_INFO: `/v3/projects/1d7b84a035b54af7abea615fceea1730/users/c6a3ae2e2c714eceb433bdf8d86afd07/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.828218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7b0f8-4150-492b-bc76-cdd73ef646a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7b84a035b54af7abea615fceea1730, user_id=c6a3ae2e2c714eceb433bdf8d86afd07, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.830938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7b0f8-4150-492b-bc76-cdd73ef646a8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.846785 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1277/2576] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:48 2022] PUT /identity/v3/projects/1d7b84a035b54af7abea615fceea1730/users/c6a3ae2e2c714eceb433bdf8d86afd07/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:48.851362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339eef3-d646-4520-a501-1f7131e2fe82 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.862257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339eef3-d646-4520-a501-1f7131e2fe82 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.926524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87f04e-e829-40e1-acae-f17cf5bef857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.927195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87f04e-e829-40e1-acae-f17cf5bef857 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.927481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87f04e-e829-40e1-acae-f17cf5bef857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.927757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87f04e-e829-40e1-acae-f17cf5bef857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.929137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87f04e-e829-40e1-acae-f17cf5bef857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.930817 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87f04e-e829-40e1-acae-f17cf5bef857 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.941247 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1300/2577] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:48.945469 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7b0f8-4150-492b-bc76-cdd73ef646a8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:48.955790 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7b0f8-4150-492b-bc76-cdd73ef646a8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:48.962383 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53c16f-8586-453c-a313-629761b3b406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:48.963270 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53c16f-8586-453c-a313-629761b3b406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.963550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53c16f-8586-453c-a313-629761b3b406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.963813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53c16f-8586-453c-a313-629761b3b406 admin admin] PATH_INFO: `/v3/projects/1d7b84a035b54af7abea615fceea1730/users/c6a3ae2e2c714eceb433bdf8d86afd07/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:48.965728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53c16f-8586-453c-a313-629761b3b406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7b84a035b54af7abea615fceea1730, user_id=c6a3ae2e2c714eceb433bdf8d86afd07, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:48.968401 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53c16f-8586-453c-a313-629761b3b406 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:48.982418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1278/2578] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:48 2022] PUT /identity/v3/projects/1d7b84a035b54af7abea615fceea1730/users/c6a3ae2e2c714eceb433bdf8d86afd07/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:48.994438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573a70a-27b6-4433-b8b5-f41632b66bca None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:48.994733 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573a70a-27b6-4433-b8b5-f41632b66bca None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:48.995016 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573a70a-27b6-4433-b8b5-f41632b66bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:49.022481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b573a70a-27b6-4433-b8b5-f41632b66bca None None] MFA Rules not processed for user `c6a3ae2e2c714eceb433bdf8d86afd07`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:49.023818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b573a70a-27b6-4433-b8b5-f41632b66bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:49.096043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1301/2579] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:49.107772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53c16f-8586-453c-a313-629761b3b406 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:49.109512 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7f53c16f-8586-453c-a313-629761b3b406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:49.168874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53c16f-8586-453c-a313-629761b3b406 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:49.172582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f00201-826b-4315-bff3-94f162c631b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:49.173231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f00201-826b-4315-bff3-94f162c631b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:49.173523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f00201-826b-4315-bff3-94f162c631b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:49.173820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f00201-826b-4315-bff3-94f162c631b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:49.183735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f00201-826b-4315-bff3-94f162c631b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:49.185166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f00201-826b-4315-bff3-94f162c631b7 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:49.194946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1279/2580] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:49 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:49.267811 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573a70a-27b6-4433-b8b5-f41632b66bca None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:49.279383 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573a70a-27b6-4433-b8b5-f41632b66bca None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:49.283075 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856992-84a2-45c7-9aea-3c88b9927cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:49.283751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856992-84a2-45c7-9aea-3c88b9927cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:49.284036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856992-84a2-45c7-9aea-3c88b9927cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:49.284316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856992-84a2-45c7-9aea-3c88b9927cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:49.342103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856992-84a2-45c7-9aea-3c88b9927cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:49.343580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856992-84a2-45c7-9aea-3c88b9927cb9 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:49.347236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:49.354546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1302/2581] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:52.065422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f00201-826b-4315-bff3-94f162c631b7 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:52.127640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f00201-826b-4315-bff3-94f162c631b7 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:52.132670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:52.133539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:52.133824 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:52.134098 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] PATH_INFO: `/v3/users/ba2af386caf44335a0d33d9df4151847` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:52.135295 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2af386caf44335a0d33d9df4151847)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:52.137184 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:52.158059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:52.184672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2af386caf44335a0d33d9df4151847'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.185310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2af386caf44335a0d33d9df4151847'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.185908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2af386caf44335a0d33d9df4151847'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.198250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2af386caf44335a0d33d9df4151847'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.205026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2af386caf44335a0d33d9df4151847'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.217197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1280/2582] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:52 2022] DELETE /identity/v3/users/ba2af386caf44335a0d33d9df4151847 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:42:52.221844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdfcf9-2abe-485e-80dd-69fae33052b9 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:52.222332 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdfcf9-2abe-485e-80dd-69fae33052b9 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:52.222487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdfcf9-2abe-485e-80dd-69fae33052b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:52.238675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a0cdfcf9-2abe-485e-80dd-69fae33052b9 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:52.240367 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a0cdfcf9-2abe-485e-80dd-69fae33052b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:52.297525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1303/2583] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:52.307659 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:52.309026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:52.368915 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d890d-368d-4972-9224-9c269ef8deae admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:52.372483 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70402a87-ac3d-4ed8-9426-3c21178bd095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:52.373204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402a87-ac3d-4ed8-9426-3c21178bd095 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:52.373487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402a87-ac3d-4ed8-9426-3c21178bd095 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:52.373768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402a87-ac3d-4ed8-9426-3c21178bd095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:52.383806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70402a87-ac3d-4ed8-9426-3c21178bd095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:52.385234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70402a87-ac3d-4ed8-9426-3c21178bd095 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:52.394907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1281/2584] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:52.664478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdfcf9-2abe-485e-80dd-69fae33052b9 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:52.665958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a0cdfcf9-2abe-485e-80dd-69fae33052b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:52.678584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdfcf9-2abe-485e-80dd-69fae33052b9 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:52.683625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:52.684487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:52.685472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:52.686117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] PATH_INFO: `/v3/projects/ef2371ec213249d4bc7b32fa2f42ec14` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:52.687487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2371ec213249d4bc7b32fa2f42ec14)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:52.689418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:52.734537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2371ec213249d4bc7b32fa2f42ec14', 'request_id': 'req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.741968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2371ec213249d4bc7b32fa2f42ec14', 'request_id': 'req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.747933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2371ec213249d4bc7b32fa2f42ec14', 'request_id': 'req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.758838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] The token cache is being invalidate because project ef2371ec213249d4bc7b32fa2f42ec14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:52.759127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.759759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.761286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1304/2585] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:52 2022] DELETE /identity/v3/projects/ef2371ec213249d4bc7b32fa2f42ec14 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:42:52.765219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70402a87-ac3d-4ed8-9426-3c21178bd095 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:52.774916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70402a87-ac3d-4ed8-9426-3c21178bd095 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:52.830067 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:52.831078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:52.831353 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:52.831628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] PATH_INFO: `/v3/users/c6a3ae2e2c714eceb433bdf8d86afd07` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:52.832880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a3ae2e2c714eceb433bdf8d86afd07)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:52.834813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:52.878892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:52.884382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a3ae2e2c714eceb433bdf8d86afd07'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.885148 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a3ae2e2c714eceb433bdf8d86afd07'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.886227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a3ae2e2c714eceb433bdf8d86afd07'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.898753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a3ae2e2c714eceb433bdf8d86afd07'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.905464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-06a5f614-f724-4b58-945a-009e08935c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a3ae2e2c714eceb433bdf8d86afd07'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:52.923263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1282/2586] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:52 2022] DELETE /identity/v3/users/c6a3ae2e2c714eceb433bdf8d86afd07 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:53.185636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:53.187204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:53.201427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef1af5-f0fe-41c1-afc9-07cd88fbcc4d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:53.258948 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:53.259802 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.260080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.260353 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] PATH_INFO: `/v3/projects/1d7b84a035b54af7abea615fceea1730` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.261519 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7b84a035b54af7abea615fceea1730)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:53.263757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:53.288368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:53.310552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7b84a035b54af7abea615fceea1730', 'request_id': 'req-75029998-d955-4e93-aa58-f7327b5ff055'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:53.317667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7b84a035b54af7abea615fceea1730', 'request_id': 'req-75029998-d955-4e93-aa58-f7327b5ff055'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:53.323111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7b84a035b54af7abea615fceea1730', 'request_id': 'req-75029998-d955-4e93-aa58-f7327b5ff055'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:53.334654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] The token cache is being invalidate because project 1d7b84a035b54af7abea615fceea1730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:53.334967 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:53.335588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75029998-d955-4e93-aa58-f7327b5ff055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:53.337114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1305/2587] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:53 2022] DELETE /identity/v3/projects/1d7b84a035b54af7abea615fceea1730 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:53.342056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee9f4d-c034-43eb-b575-f3c621f11a8a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.342546 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee9f4d-c034-43eb-b575-f3c621f11a8a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.342647 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee9f4d-c034-43eb-b575-f3c621f11a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.359782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-afee9f4d-c034-43eb-b575-f3c621f11a8a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:53.360987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-afee9f4d-c034-43eb-b575-f3c621f11a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:53.419101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1283/2588] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:53.426620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf094b6e-5ca6-4a9a-8df3-1f628d69f3d5 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.426908 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf094b6e-5ca6-4a9a-8df3-1f628d69f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.427183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf094b6e-5ca6-4a9a-8df3-1f628d69f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.445760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-cf094b6e-5ca6-4a9a-8df3-1f628d69f3d5 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:53.447028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-cf094b6e-5ca6-4a9a-8df3-1f628d69f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:53.455668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1306/2589] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:53.460398 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee9f4d-c034-43eb-b575-f3c621f11a8a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:53.469952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee9f4d-c034-43eb-b575-f3c621f11a8a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:53.474555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3a3b7-2ea1-4dc2-b35a-d079bc8fd75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:53.475192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a3b7-2ea1-4dc2-b35a-d079bc8fd75b admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.475475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a3b7-2ea1-4dc2-b35a-d079bc8fd75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.475750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a3b7-2ea1-4dc2-b35a-d079bc8fd75b admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.476464 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3a3b7-2ea1-4dc2-b35a-d079bc8fd75b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:53.476772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3a3b7-2ea1-4dc2-b35a-d079bc8fd75b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:53.478338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3a3b7-2ea1-4dc2-b35a-d079bc8fd75b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:53.489495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1284/2590] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:53.493937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf094b6e-5ca6-4a9a-8df3-1f628d69f3d5 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:53.503186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf094b6e-5ca6-4a9a-8df3-1f628d69f3d5 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:53.508290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf58ae8-1b20-459e-8aef-30142a51ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:53.508937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf58ae8-1b20-459e-8aef-30142a51ce56 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.509219 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf58ae8-1b20-459e-8aef-30142a51ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.509494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf58ae8-1b20-459e-8aef-30142a51ce56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.510203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf58ae8-1b20-459e-8aef-30142a51ce56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:53.512182 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf58ae8-1b20-459e-8aef-30142a51ce56 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:53.536942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1307/2591] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:53 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:53.540889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3a3b7-2ea1-4dc2-b35a-d079bc8fd75b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:53.550913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3a3b7-2ea1-4dc2-b35a-d079bc8fd75b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:53.610115 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2c47-2de0-4ae5-8f34-4dae411edc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:53.610799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2c47-2de0-4ae5-8f34-4dae411edc1c admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.611084 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2c47-2de0-4ae5-8f34-4dae411edc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.611360 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2c47-2de0-4ae5-8f34-4dae411edc1c admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.612032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d2c47-2de0-4ae5-8f34-4dae411edc1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:53.613924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d2c47-2de0-4ae5-8f34-4dae411edc1c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:53.633475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1285/2592] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:53 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:53.637484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf58ae8-1b20-459e-8aef-30142a51ce56 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:53.647991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf58ae8-1b20-459e-8aef-30142a51ce56 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:53.652815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e44659-cbf0-4f4f-83ee-642692125e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:53.653504 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e44659-cbf0-4f4f-83ee-642692125e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.653796 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e44659-cbf0-4f4f-83ee-642692125e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.654072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e44659-cbf0-4f4f-83ee-642692125e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.654833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e44659-cbf0-4f4f-83ee-642692125e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:53.656462 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e44659-cbf0-4f4f-83ee-642692125e7f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:53.667561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1308/2593] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:53.671529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2c47-2de0-4ae5-8f34-4dae411edc1c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:53.681835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2c47-2de0-4ae5-8f34-4dae411edc1c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:53.686458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d6d79-af90-4c55-b1f5-59e95dd786f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:53.687103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d6d79-af90-4c55-b1f5-59e95dd786f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.687386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d6d79-af90-4c55-b1f5-59e95dd786f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.687689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d6d79-af90-4c55-b1f5-59e95dd786f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.688446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d6d79-af90-4c55-b1f5-59e95dd786f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:53.690161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d6d79-af90-4c55-b1f5-59e95dd786f3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:53.700653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1286/2594] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:53.704537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e44659-cbf0-4f4f-83ee-642692125e7f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:53.714279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e44659-cbf0-4f4f-83ee-642692125e7f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:53.719044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a244d-d9e1-4a5a-9d2a-f1ebc1dcc47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:53.719914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a244d-d9e1-4a5a-9d2a-f1ebc1dcc47f admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.720199 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a244d-d9e1-4a5a-9d2a-f1ebc1dcc47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.720477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a244d-d9e1-4a5a-9d2a-f1ebc1dcc47f admin admin] PATH_INFO: `/v3/projects/7ff10c122bf44550ae8d99f559d10cc9/users/b2d50e94e6a54b29aaee916baad25aa2/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.734808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a244d-d9e1-4a5a-9d2a-f1ebc1dcc47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff10c122bf44550ae8d99f559d10cc9, user_id=b2d50e94e6a54b29aaee916baad25aa2, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:53.737450 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a244d-d9e1-4a5a-9d2a-f1ebc1dcc47f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:53.751422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1309/2595] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:53 2022] PUT /identity/v3/projects/7ff10c122bf44550ae8d99f559d10cc9/users/b2d50e94e6a54b29aaee916baad25aa2/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:53.762285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8baae9-a02c-40ee-ba9a-336bd5ca677e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.762614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8baae9-a02c-40ee-ba9a-336bd5ca677e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.762896 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8baae9-a02c-40ee-ba9a-336bd5ca677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.788173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1e8baae9-a02c-40ee-ba9a-336bd5ca677e None None] MFA Rules not processed for user `b2d50e94e6a54b29aaee916baad25aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:53.789368 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1e8baae9-a02c-40ee-ba9a-336bd5ca677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:53.800954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:53.854832 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1287/2596] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:53.859213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a244d-d9e1-4a5a-9d2a-f1ebc1dcc47f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:53.921056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a244d-d9e1-4a5a-9d2a-f1ebc1dcc47f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:53.926280 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5d95-ea00-4c27-bd5b-481ee81a1928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:53.927735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5d95-ea00-4c27-bd5b-481ee81a1928 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:53.928047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5d95-ea00-4c27-bd5b-481ee81a1928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:53.928329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5d95-ea00-4c27-bd5b-481ee81a1928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:53.929019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f5d95-ea00-4c27-bd5b-481ee81a1928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:53.931070 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f5d95-ea00-4c27-bd5b-481ee81a1928 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:53.955386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1310/2597] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:53 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:53.960120 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8baae9-a02c-40ee-ba9a-336bd5ca677e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:53.970544 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8baae9-a02c-40ee-ba9a-336bd5ca677e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:54.026103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2546518-3307-4e1d-b366-e774aa87d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:54.026795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2546518-3307-4e1d-b366-e774aa87d845 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:54.027079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2546518-3307-4e1d-b366-e774aa87d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:54.027354 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2546518-3307-4e1d-b366-e774aa87d845 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:54.028028 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2546518-3307-4e1d-b366-e774aa87d845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:54.029924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2546518-3307-4e1d-b366-e774aa87d845 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:54.051762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1288/2598] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:53 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:54.055915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5d95-ea00-4c27-bd5b-481ee81a1928 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:54.066087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5d95-ea00-4c27-bd5b-481ee81a1928 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:54.071206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e0d72-e267-4b14-99c6-aa63a08be420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:54.071856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e0d72-e267-4b14-99c6-aa63a08be420 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:54.072143 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e0d72-e267-4b14-99c6-aa63a08be420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:54.072422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e0d72-e267-4b14-99c6-aa63a08be420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:54.073145 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e0d72-e267-4b14-99c6-aa63a08be420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:54.074782 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e0d72-e267-4b14-99c6-aa63a08be420 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:54.085841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1311/2599] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:54.089752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2546518-3307-4e1d-b366-e774aa87d845 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:54.099442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2546518-3307-4e1d-b366-e774aa87d845 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:54.103993 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb727440-3024-4d53-a978-2babe783a465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:54.104855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb727440-3024-4d53-a978-2babe783a465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:54.105142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb727440-3024-4d53-a978-2babe783a465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:54.105422 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb727440-3024-4d53-a978-2babe783a465 admin admin] PATH_INFO: `/v3/projects/9eaa3b31fb5948d19a266d382f2dcd39/users/faee71dbe0f54812937d4e3b2270bfd5/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:54.121091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb727440-3024-4d53-a978-2babe783a465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eaa3b31fb5948d19a266d382f2dcd39, user_id=faee71dbe0f54812937d4e3b2270bfd5, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:54.123747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb727440-3024-4d53-a978-2babe783a465 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:54.136696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1289/2600] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:54 2022] PUT /identity/v3/projects/9eaa3b31fb5948d19a266d382f2dcd39/users/faee71dbe0f54812937d4e3b2270bfd5/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:54.140512 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e0d72-e267-4b14-99c6-aa63a08be420 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:54.150835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e0d72-e267-4b14-99c6-aa63a08be420 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:54.168906 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:54.207523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aa4ba-86ec-40ba-9926-4b2e2601863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:54.208652 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa4ba-86ec-40ba-9926-4b2e2601863c admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:54.208933 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa4ba-86ec-40ba-9926-4b2e2601863c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:54.209210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa4ba-86ec-40ba-9926-4b2e2601863c admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:54.209928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aa4ba-86ec-40ba-9926-4b2e2601863c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:54.211546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aa4ba-86ec-40ba-9926-4b2e2601863c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:54.221042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1312/2601] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:54.225025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb727440-3024-4d53-a978-2babe783a465 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:54.235112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb727440-3024-4d53-a978-2babe783a465 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:54.239636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d716c1-789e-494c-af95-5217d3042fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:54.240497 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d716c1-789e-494c-af95-5217d3042fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:54.240780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d716c1-789e-494c-af95-5217d3042fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:54.241053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d716c1-789e-494c-af95-5217d3042fb9 admin admin] PATH_INFO: `/v3/projects/9eaa3b31fb5948d19a266d382f2dcd39/users/faee71dbe0f54812937d4e3b2270bfd5/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:54.243000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d716c1-789e-494c-af95-5217d3042fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eaa3b31fb5948d19a266d382f2dcd39, user_id=faee71dbe0f54812937d4e3b2270bfd5, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:54.245844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d716c1-789e-494c-af95-5217d3042fb9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:54.256341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1290/2602] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:54 2022] PUT /identity/v3/projects/9eaa3b31fb5948d19a266d382f2dcd39/users/faee71dbe0f54812937d4e3b2270bfd5/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:54.267326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfecd9c-cdb8-4ab7-84c1-313a75c22558 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:54.267797 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfecd9c-cdb8-4ab7-84c1-313a75c22558 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:54.267921 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfecd9c-cdb8-4ab7-84c1-313a75c22558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:54.295026 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6dfecd9c-cdb8-4ab7-84c1-313a75c22558 None None] MFA Rules not processed for user `faee71dbe0f54812937d4e3b2270bfd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:54.296229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6dfecd9c-cdb8-4ab7-84c1-313a75c22558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:54.364760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1313/2603] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:54.376167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d716c1-789e-494c-af95-5217d3042fb9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:54.377883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-45d716c1-789e-494c-af95-5217d3042fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:54.434900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d716c1-789e-494c-af95-5217d3042fb9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:54.438634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996d1ef-504a-4b5b-9454-25455f6abaf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:54.439279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996d1ef-504a-4b5b-9454-25455f6abaf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:54.439568 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996d1ef-504a-4b5b-9454-25455f6abaf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:54.439850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996d1ef-504a-4b5b-9454-25455f6abaf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:54.449744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996d1ef-504a-4b5b-9454-25455f6abaf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:54.451466 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996d1ef-504a-4b5b-9454-25455f6abaf9 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:54.461506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1291/2604] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:54.503501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfecd9c-cdb8-4ab7-84c1-313a75c22558 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:54.505479 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6dfecd9c-cdb8-4ab7-84c1-313a75c22558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:54.517167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfecd9c-cdb8-4ab7-84c1-313a75c22558 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:54.520808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3892bda-8c05-4bf8-8c80-9b1f5ab13ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:54.521443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3892bda-8c05-4bf8-8c80-9b1f5ab13ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:54.521726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3892bda-8c05-4bf8-8c80-9b1f5ab13ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:54.522002 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3892bda-8c05-4bf8-8c80-9b1f5ab13ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:54.578635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3892bda-8c05-4bf8-8c80-9b1f5ab13ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:54.580122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3892bda-8c05-4bf8-8c80-9b1f5ab13ea6 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:54.589034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1314/2605] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:57.827690 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996d1ef-504a-4b5b-9454-25455f6abaf9 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:57.838022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:57.890615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996d1ef-504a-4b5b-9454-25455f6abaf9 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:57.895290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:57.896698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:57.896975 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:57.897248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] PATH_INFO: `/v3/users/b2d50e94e6a54b29aaee916baad25aa2` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:57.898472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d50e94e6a54b29aaee916baad25aa2)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:57.900362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:57.945589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d50e94e6a54b29aaee916baad25aa2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:57.946254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d50e94e6a54b29aaee916baad25aa2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:57.946895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d50e94e6a54b29aaee916baad25aa2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:57.959449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d50e94e6a54b29aaee916baad25aa2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:57.966218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d50e94e6a54b29aaee916baad25aa2'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:57.978560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1292/2606] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:57 2022] DELETE /identity/v3/users/b2d50e94e6a54b29aaee916baad25aa2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:57.983060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875bd32-ad45-4899-a41e-37d4a72e8230 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:57.983601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875bd32-ad45-4899-a41e-37d4a72e8230 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:57.983709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875bd32-ad45-4899-a41e-37d4a72e8230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:58.000815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5875bd32-ad45-4899-a41e-37d4a72e8230 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:58.002013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5875bd32-ad45-4899-a41e-37d4a72e8230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:58.039587 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:58.060397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1315/2607] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:58.070744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:58.072260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:58.129490 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a7cf6-3dea-47f0-9689-ee089e7ec4db admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:58.133675 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1a94-edab-4806-8e90-c04d0fabf126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:58.134315 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1a94-edab-4806-8e90-c04d0fabf126 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:58.134633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1a94-edab-4806-8e90-c04d0fabf126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:58.134911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1a94-edab-4806-8e90-c04d0fabf126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:58.143883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1a94-edab-4806-8e90-c04d0fabf126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:58.145307 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1a94-edab-4806-8e90-c04d0fabf126 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:58.155524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1293/2608] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:42:58.441358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875bd32-ad45-4899-a41e-37d4a72e8230 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:58.443501 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5875bd32-ad45-4899-a41e-37d4a72e8230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:58.456474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875bd32-ad45-4899-a41e-37d4a72e8230 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:58.461129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:58.462032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:58.462322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:58.462633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] PATH_INFO: `/v3/projects/7ff10c122bf44550ae8d99f559d10cc9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:58.463825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff10c122bf44550ae8d99f559d10cc9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:58.465748 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:58.513132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff10c122bf44550ae8d99f559d10cc9', 'request_id': 'req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:58.520899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff10c122bf44550ae8d99f559d10cc9', 'request_id': 'req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:58.527203 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff10c122bf44550ae8d99f559d10cc9', 'request_id': 'req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:58.539829 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] The token cache is being invalidate because project 7ff10c122bf44550ae8d99f559d10cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:58.540124 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:58.540790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:58.542345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1316/2609] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:58 2022] DELETE /identity/v3/projects/7ff10c122bf44550ae8d99f559d10cc9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:58.546270 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1a94-edab-4806-8e90-c04d0fabf126 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:58.556485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1a94-edab-4806-8e90-c04d0fabf126 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:58.585259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:58.613533 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:58.614418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:58.615300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:58.615574 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] PATH_INFO: `/v3/users/faee71dbe0f54812937d4e3b2270bfd5` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:58.616724 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=faee71dbe0f54812937d4e3b2270bfd5)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:58.618903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:58.665844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faee71dbe0f54812937d4e3b2270bfd5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:58.666529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faee71dbe0f54812937d4e3b2270bfd5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:58.667137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faee71dbe0f54812937d4e3b2270bfd5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:58.679918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faee71dbe0f54812937d4e3b2270bfd5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:58.686693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-95a7a865-84c9-46b5-a790-4003df29e16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faee71dbe0f54812937d4e3b2270bfd5'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:58.699251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1294/2610] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:42:58 2022] DELETE /identity/v3/users/faee71dbe0f54812937d4e3b2270bfd5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:58.957801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:58.959761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:58.974891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb3c0c-e1c6-4d99-9a47-3f4031bc775c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.031563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.032415 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.032696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.032970 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] PATH_INFO: `/v3/projects/9eaa3b31fb5948d19a266d382f2dcd39` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.034125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eaa3b31fb5948d19a266d382f2dcd39)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.036061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.080700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eaa3b31fb5948d19a266d382f2dcd39', 'request_id': 'req-66a76439-ac84-45c0-aa61-c550dd005171'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:59.088039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eaa3b31fb5948d19a266d382f2dcd39', 'request_id': 'req-66a76439-ac84-45c0-aa61-c550dd005171'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:59.093669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eaa3b31fb5948d19a266d382f2dcd39', 'request_id': 'req-66a76439-ac84-45c0-aa61-c550dd005171'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:59.095607 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:59.107083 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] The token cache is being invalidate because project 9eaa3b31fb5948d19a266d382f2dcd39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:42:59.107368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:59.107998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-66a76439-ac84-45c0-aa61-c550dd005171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:42:59.109511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1317/2611] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:42:58 2022] DELETE /identity/v3/projects/9eaa3b31fb5948d19a266d382f2dcd39 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:59.116740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb22bc-12df-4c62-aaa8-b32191f16c7b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.117259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb22bc-12df-4c62-aaa8-b32191f16c7b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.117362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb22bc-12df-4c62-aaa8-b32191f16c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.134841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-45bb22bc-12df-4c62-aaa8-b32191f16c7b None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:59.136120 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-45bb22bc-12df-4c62-aaa8-b32191f16c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:59.196649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1295/2612] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:59.204137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bbd45-eaa5-41fc-8107-a12feaa593ba None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.204427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bbd45-eaa5-41fc-8107-a12feaa593ba None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.204704 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bbd45-eaa5-41fc-8107-a12feaa593ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.224650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2d2bbd45-eaa5-41fc-8107-a12feaa593ba None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:59.225903 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2d2bbd45-eaa5-41fc-8107-a12feaa593ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:59.234274 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1318/2613] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:42:59.238386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb22bc-12df-4c62-aaa8-b32191f16c7b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.248501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb22bc-12df-4c62-aaa8-b32191f16c7b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.253128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c24cfc-61d7-4d49-ad68-83022788e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.253811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c24cfc-61d7-4d49-ad68-83022788e130 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.254095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c24cfc-61d7-4d49-ad68-83022788e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.254399 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c24cfc-61d7-4d49-ad68-83022788e130 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.255128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c24cfc-61d7-4d49-ad68-83022788e130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:42:59.255430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c24cfc-61d7-4d49-ad68-83022788e130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.257049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c24cfc-61d7-4d49-ad68-83022788e130 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.270392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1296/2614] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:42:59.274765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bbd45-eaa5-41fc-8107-a12feaa593ba None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.284221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bbd45-eaa5-41fc-8107-a12feaa593ba None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.289472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd757d-b741-46e9-a0d1-bc08e913908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.290160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd757d-b741-46e9-a0d1-bc08e913908f admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.290478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd757d-b741-46e9-a0d1-bc08e913908f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.290770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd757d-b741-46e9-a0d1-bc08e913908f admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.291463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd757d-b741-46e9-a0d1-bc08e913908f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.293370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd757d-b741-46e9-a0d1-bc08e913908f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.323044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1319/2615] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:59 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:59.324221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c24cfc-61d7-4d49-ad68-83022788e130 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.335044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c24cfc-61d7-4d49-ad68-83022788e130 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.370836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:42:59.405554 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c9607-a156-4236-b091-745345be9ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.406337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9607-a156-4236-b091-745345be9ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.406772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9607-a156-4236-b091-745345be9ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.407056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9607-a156-4236-b091-745345be9ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.407747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c9607-a156-4236-b091-745345be9ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.409663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c9607-a156-4236-b091-745345be9ff7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.434641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1297/2616] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:59 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:59.436932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd757d-b741-46e9-a0d1-bc08e913908f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.448392 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd757d-b741-46e9-a0d1-bc08e913908f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.455029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e92661-6561-466c-9ef6-3e0efc1013bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.455920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e92661-6561-466c-9ef6-3e0efc1013bd admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.456335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e92661-6561-466c-9ef6-3e0efc1013bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.456776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e92661-6561-466c-9ef6-3e0efc1013bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.457795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e92661-6561-466c-9ef6-3e0efc1013bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.466143 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e92661-6561-466c-9ef6-3e0efc1013bd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.477913 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1320/2617] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:59.481843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c9607-a156-4236-b091-745345be9ff7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.492811 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c9607-a156-4236-b091-745345be9ff7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.498639 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a671a6-8247-418b-a273-0525354765bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.499322 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a671a6-8247-418b-a273-0525354765bc admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.499608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a671a6-8247-418b-a273-0525354765bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.499886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a671a6-8247-418b-a273-0525354765bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.500611 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a671a6-8247-418b-a273-0525354765bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.502190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a671a6-8247-418b-a273-0525354765bc admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.512936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1298/2618] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:59.517214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e92661-6561-466c-9ef6-3e0efc1013bd admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.527599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e92661-6561-466c-9ef6-3e0efc1013bd admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.532597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baccd8-a21d-4fb2-af6b-97e33dbd8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.533472 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baccd8-a21d-4fb2-af6b-97e33dbd8c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.533756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baccd8-a21d-4fb2-af6b-97e33dbd8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.534034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baccd8-a21d-4fb2-af6b-97e33dbd8c58 admin admin] PATH_INFO: `/v3/projects/a5022210a52d4fa4a1c405fc2c52bfec/users/6b7863126e864d2ea43c51e4b443e112/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.550114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baccd8-a21d-4fb2-af6b-97e33dbd8c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5022210a52d4fa4a1c405fc2c52bfec, user_id=6b7863126e864d2ea43c51e4b443e112, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.553463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baccd8-a21d-4fb2-af6b-97e33dbd8c58 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.565757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1321/2619] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:59 2022] PUT /identity/v3/projects/a5022210a52d4fa4a1c405fc2c52bfec/users/6b7863126e864d2ea43c51e4b443e112/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:59.576569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddbe87-1816-4ed8-a5b1-32bf36b32fae None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.576897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddbe87-1816-4ed8-a5b1-32bf36b32fae None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.577184 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddbe87-1816-4ed8-a5b1-32bf36b32fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.604410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-40ddbe87-1816-4ed8-a5b1-32bf36b32fae None None] MFA Rules not processed for user `6b7863126e864d2ea43c51e4b443e112`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:42:59.605559 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-40ddbe87-1816-4ed8-a5b1-32bf36b32fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:42:59.669036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1299/2620] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:42:59.673594 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baccd8-a21d-4fb2-af6b-97e33dbd8c58 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.736522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baccd8-a21d-4fb2-af6b-97e33dbd8c58 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.741197 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499f352-ee45-431e-97d9-f39baf157342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.741839 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499f352-ee45-431e-97d9-f39baf157342 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.742123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499f352-ee45-431e-97d9-f39baf157342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.742427 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499f352-ee45-431e-97d9-f39baf157342 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.743111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499f352-ee45-431e-97d9-f39baf157342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.745317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499f352-ee45-431e-97d9-f39baf157342 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.771216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1322/2621] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:42:59 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:59.774162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddbe87-1816-4ed8-a5b1-32bf36b32fae None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.784704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddbe87-1816-4ed8-a5b1-32bf36b32fae None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.842723 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ed616-89d6-4cc4-93d0-4718306bf0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.843397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ed616-89d6-4cc4-93d0-4718306bf0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.843682 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ed616-89d6-4cc4-93d0-4718306bf0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.843961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ed616-89d6-4cc4-93d0-4718306bf0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.844686 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ed616-89d6-4cc4-93d0-4718306bf0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.846616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ed616-89d6-4cc4-93d0-4718306bf0f1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.865859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1300/2622] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:42:59 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:42:59.870039 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499f352-ee45-431e-97d9-f39baf157342 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.880709 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499f352-ee45-431e-97d9-f39baf157342 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.885258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36c280-76a1-4347-9c99-057712a9ab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.885902 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36c280-76a1-4347-9c99-057712a9ab02 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.886188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36c280-76a1-4347-9c99-057712a9ab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.886510 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36c280-76a1-4347-9c99-057712a9ab02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.887238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36c280-76a1-4347-9c99-057712a9ab02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.888825 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36c280-76a1-4347-9c99-057712a9ab02 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.899792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1323/2623] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:42:59.903763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ed616-89d6-4cc4-93d0-4718306bf0f1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.914114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ed616-89d6-4cc4-93d0-4718306bf0f1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:42:59.918736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeab194-7b0c-4385-9760-80ba96556e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:42:59.919602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeab194-7b0c-4385-9760-80ba96556e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:42:59.919888 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeab194-7b0c-4385-9760-80ba96556e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:42:59.920168 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeab194-7b0c-4385-9760-80ba96556e61 admin admin] PATH_INFO: `/v3/projects/618580d0a43d43fd931e38c254258da8/users/578d9fe0de4a4ce8827d4b1d4cfa170c/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:42:59.935880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeab194-7b0c-4385-9760-80ba96556e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618580d0a43d43fd931e38c254258da8, user_id=578d9fe0de4a4ce8827d4b1d4cfa170c, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:42:59.938567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeab194-7b0c-4385-9760-80ba96556e61 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:42:59.951302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1301/2624] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:42:59 2022] PUT /identity/v3/projects/618580d0a43d43fd931e38c254258da8/users/578d9fe0de4a4ce8827d4b1d4cfa170c/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:42:59.955279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36c280-76a1-4347-9c99-057712a9ab02 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:42:59.966100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36c280-76a1-4347-9c99-057712a9ab02 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:00.023034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd0205-674a-4038-8e48-9925cd0e95d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:00.023699 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0205-674a-4038-8e48-9925cd0e95d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:00.023987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0205-674a-4038-8e48-9925cd0e95d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:00.024266 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0205-674a-4038-8e48-9925cd0e95d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:00.024991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd0205-674a-4038-8e48-9925cd0e95d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:00.026614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd0205-674a-4038-8e48-9925cd0e95d5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:00.036207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1324/2625] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:00.040939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeab194-7b0c-4385-9760-80ba96556e61 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:00.051069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeab194-7b0c-4385-9760-80ba96556e61 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:00.055692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84256e36-f633-497d-998d-cb1a81b7dde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:00.056558 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84256e36-f633-497d-998d-cb1a81b7dde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:00.056843 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84256e36-f633-497d-998d-cb1a81b7dde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:00.057122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84256e36-f633-497d-998d-cb1a81b7dde6 admin admin] PATH_INFO: `/v3/projects/618580d0a43d43fd931e38c254258da8/users/578d9fe0de4a4ce8827d4b1d4cfa170c/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:00.059071 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84256e36-f633-497d-998d-cb1a81b7dde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618580d0a43d43fd931e38c254258da8, user_id=578d9fe0de4a4ce8827d4b1d4cfa170c, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:00.061672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84256e36-f633-497d-998d-cb1a81b7dde6 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:00.067097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:00.073232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1302/2626] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:00 2022] PUT /identity/v3/projects/618580d0a43d43fd931e38c254258da8/users/578d9fe0de4a4ce8827d4b1d4cfa170c/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:00.085060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f055d-aa08-43d5-bfc7-1f6553509cf8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:00.085388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f055d-aa08-43d5-bfc7-1f6553509cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:00.085651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f055d-aa08-43d5-bfc7-1f6553509cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:00.091572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:00.112752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1a4f055d-aa08-43d5-bfc7-1f6553509cf8 None None] MFA Rules not processed for user `578d9fe0de4a4ce8827d4b1d4cfa170c`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:00.113962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1a4f055d-aa08-43d5-bfc7-1f6553509cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:00.180622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1325/2627] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:00.191590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84256e36-f633-497d-998d-cb1a81b7dde6 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:00.193939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-84256e36-f633-497d-998d-cb1a81b7dde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:00.250482 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84256e36-f633-497d-998d-cb1a81b7dde6 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:00.254042 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ebeea-cdbf-4d23-9b19-5bb7b52aaaab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:00.254714 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ebeea-cdbf-4d23-9b19-5bb7b52aaaab service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:00.255001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ebeea-cdbf-4d23-9b19-5bb7b52aaaab service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:00.259227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ebeea-cdbf-4d23-9b19-5bb7b52aaaab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:00.271990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ebeea-cdbf-4d23-9b19-5bb7b52aaaab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:00.273424 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ebeea-cdbf-4d23-9b19-5bb7b52aaaab service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:00.285657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1303/2628] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:00.330745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f055d-aa08-43d5-bfc7-1f6553509cf8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:00.332130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1a4f055d-aa08-43d5-bfc7-1f6553509cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:00.344357 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f055d-aa08-43d5-bfc7-1f6553509cf8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:00.347973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c01b9c-193e-4189-92cb-7c803ccae670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:00.348611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c01b9c-193e-4189-92cb-7c803ccae670 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:00.348962 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c01b9c-193e-4189-92cb-7c803ccae670 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:00.349352 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c01b9c-193e-4189-92cb-7c803ccae670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:00.408077 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c01b9c-193e-4189-92cb-7c803ccae670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:00.409524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c01b9c-193e-4189-92cb-7c803ccae670 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:00.418724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1326/2629] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:03.637107 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ebeea-cdbf-4d23-9b19-5bb7b52aaaab service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:03.697566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ebeea-cdbf-4d23-9b19-5bb7b52aaaab service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:03.702044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:03.702929 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:03.703212 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:03.703486 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] PATH_INFO: `/v3/users/6b7863126e864d2ea43c51e4b443e112` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:03.704673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7863126e864d2ea43c51e4b443e112)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:03.706623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:03.751479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7863126e864d2ea43c51e4b443e112'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:03.752064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7863126e864d2ea43c51e4b443e112'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:03.752713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7863126e864d2ea43c51e4b443e112'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:03.765287 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7863126e864d2ea43c51e4b443e112'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:03.772159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7863126e864d2ea43c51e4b443e112'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:03.784278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1304/2630] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:03 2022] DELETE /identity/v3/users/6b7863126e864d2ea43c51e4b443e112 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:03.789338 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1542595-e131-450f-9324-979f5f749244 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:03.789820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1542595-e131-450f-9324-979f5f749244 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:03.789942 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1542595-e131-450f-9324-979f5f749244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:03.807169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a1542595-e131-450f-9324-979f5f749244 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:03.808383 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a1542595-e131-450f-9324-979f5f749244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:03.865988 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1327/2631] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:03.875952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:03.877346 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:03.899014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:03.937660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63d540-b7ef-49d5-8306-29d7f2ed7751 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:03.941549 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ab89-39f2-4f42-a188-4f08fafce8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:03.942198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ab89-39f2-4f42-a188-4f08fafce8ca service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:03.942575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ab89-39f2-4f42-a188-4f08fafce8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:03.942871 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ab89-39f2-4f42-a188-4f08fafce8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:03.952151 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2ab89-39f2-4f42-a188-4f08fafce8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:03.953582 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2ab89-39f2-4f42-a188-4f08fafce8ca service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:03.963489 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1305/2632] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:04.508481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1542595-e131-450f-9324-979f5f749244 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:04.510019 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a1542595-e131-450f-9324-979f5f749244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:04.524976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1542595-e131-450f-9324-979f5f749244 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:04.529732 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:04.530647 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:04.530938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:04.531222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] PATH_INFO: `/v3/projects/a5022210a52d4fa4a1c405fc2c52bfec` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:04.533341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5022210a52d4fa4a1c405fc2c52bfec)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:04.535404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:04.560482 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=100 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:04.588802 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5022210a52d4fa4a1c405fc2c52bfec', 'request_id': 'req-714aa35b-f2f6-4c49-870e-a0064754f9f4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:04.596961 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5022210a52d4fa4a1c405fc2c52bfec', 'request_id': 'req-714aa35b-f2f6-4c49-870e-a0064754f9f4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:04.603676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5022210a52d4fa4a1c405fc2c52bfec', 'request_id': 'req-714aa35b-f2f6-4c49-870e-a0064754f9f4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:04.614826 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] The token cache is being invalidate because project a5022210a52d4fa4a1c405fc2c52bfec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:04.615111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:04.615771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:04.617682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1328/2633] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:04 2022] DELETE /identity/v3/projects/a5022210a52d4fa4a1c405fc2c52bfec => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:04.622802 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ab89-39f2-4f42-a188-4f08fafce8ca service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:04.632594 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ab89-39f2-4f42-a188-4f08fafce8ca service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:04.695743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:04.696615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:04.696900 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:04.697177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] PATH_INFO: `/v3/users/578d9fe0de4a4ce8827d4b1d4cfa170c` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:04.698725 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578d9fe0de4a4ce8827d4b1d4cfa170c)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:04.700859 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:04.749150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578d9fe0de4a4ce8827d4b1d4cfa170c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:04.749800 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578d9fe0de4a4ce8827d4b1d4cfa170c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:04.750452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578d9fe0de4a4ce8827d4b1d4cfa170c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:04.762429 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578d9fe0de4a4ce8827d4b1d4cfa170c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:04.769385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-99bd0bfe-b927-4ee0-beb1-5211cb193615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578d9fe0de4a4ce8827d4b1d4cfa170c'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:04.782674 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1306/2634] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:04 2022] DELETE /identity/v3/users/578d9fe0de4a4ce8827d4b1d4cfa170c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:05.066408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:05.068490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:05.082376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714aa35b-f2f6-4c49-870e-a0064754f9f4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:05.139849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:05.140735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.141024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.141324 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] PATH_INFO: `/v3/projects/618580d0a43d43fd931e38c254258da8` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.142523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=618580d0a43d43fd931e38c254258da8)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:05.144434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:05.190215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618580d0a43d43fd931e38c254258da8', 'request_id': 'req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:05.198636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618580d0a43d43fd931e38c254258da8', 'request_id': 'req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:05.204046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618580d0a43d43fd931e38c254258da8', 'request_id': 'req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:05.215559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] The token cache is being invalidate because project 618580d0a43d43fd931e38c254258da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:05.215853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:05.216484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b8c90598-52b8-4f07-bc50-3e5818f8ae9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:05.218045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1329/2635] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:05 2022] DELETE /identity/v3/projects/618580d0a43d43fd931e38c254258da8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:05.223266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe7e9e-ed3d-4d11-9acf-9de9e3ec5612 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.223653 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe7e9e-ed3d-4d11-9acf-9de9e3ec5612 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.223942 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe7e9e-ed3d-4d11-9acf-9de9e3ec5612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.241059 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3dbe7e9e-ed3d-4d11-9acf-9de9e3ec5612 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:05.242296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3dbe7e9e-ed3d-4d11-9acf-9de9e3ec5612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:05.281044 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:05.304340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1307/2636] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:05.311973 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b66f-c0b1-499f-890f-5a881a69dc27 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.312268 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b66f-c0b1-499f-890f-5a881a69dc27 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.312555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b66f-c0b1-499f-890f-5a881a69dc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.332191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-6d67b66f-c0b1-499f-890f-5a881a69dc27 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:05.333473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-6d67b66f-c0b1-499f-890f-5a881a69dc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:05.341528 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1330/2637] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:05.345764 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe7e9e-ed3d-4d11-9acf-9de9e3ec5612 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:05.356037 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe7e9e-ed3d-4d11-9acf-9de9e3ec5612 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:05.360676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d5505-1d3c-4e00-8cdb-5f3a050647ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:05.361453 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d5505-1d3c-4e00-8cdb-5f3a050647ef admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.361741 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d5505-1d3c-4e00-8cdb-5f3a050647ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.362017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d5505-1d3c-4e00-8cdb-5f3a050647ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.362772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d5505-1d3c-4e00-8cdb-5f3a050647ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:05.363082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d5505-1d3c-4e00-8cdb-5f3a050647ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:05.365211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d5505-1d3c-4e00-8cdb-5f3a050647ef admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:05.382090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1308/2638] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:05.383389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67b66f-c0b1-499f-890f-5a881a69dc27 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:05.398755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67b66f-c0b1-499f-890f-5a881a69dc27 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:05.403527 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d2fe-a51c-4f9f-b2cf-0a813f3f97c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:05.404185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d2fe-a51c-4f9f-b2cf-0a813f3f97c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.404467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d2fe-a51c-4f9f-b2cf-0a813f3f97c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.404742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d2fe-a51c-4f9f-b2cf-0a813f3f97c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.405516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9d2fe-a51c-4f9f-b2cf-0a813f3f97c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:05.407363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9d2fe-a51c-4f9f-b2cf-0a813f3f97c8 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:05.433776 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1331/2639] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:05 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:05.438610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d5505-1d3c-4e00-8cdb-5f3a050647ef admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:05.450371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d5505-1d3c-4e00-8cdb-5f3a050647ef admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:05.516090 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc9ddd-7c0f-43c2-a399-7d797b6c508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:05.516756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc9ddd-7c0f-43c2-a399-7d797b6c508d admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.517042 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc9ddd-7c0f-43c2-a399-7d797b6c508d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.517319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc9ddd-7c0f-43c2-a399-7d797b6c508d admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.518001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc9ddd-7c0f-43c2-a399-7d797b6c508d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:05.520008 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc9ddd-7c0f-43c2-a399-7d797b6c508d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:05.539670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1309/2640] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:05 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:05.544058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d2fe-a51c-4f9f-b2cf-0a813f3f97c8 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:05.555493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d2fe-a51c-4f9f-b2cf-0a813f3f97c8 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:05.560617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168ed05-f8c5-4d56-a966-dd8a82347f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:05.561978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168ed05-f8c5-4d56-a966-dd8a82347f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.562265 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168ed05-f8c5-4d56-a966-dd8a82347f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.562691 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168ed05-f8c5-4d56-a966-dd8a82347f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.563477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168ed05-f8c5-4d56-a966-dd8a82347f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:05.565087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168ed05-f8c5-4d56-a966-dd8a82347f80 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:05.573682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:05.579833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1332/2641] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:05.584195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc9ddd-7c0f-43c2-a399-7d797b6c508d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:05.594955 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc9ddd-7c0f-43c2-a399-7d797b6c508d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:05.600117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae89a7-4d3e-4bc9-8047-1ce42b17f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:05.600985 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae89a7-4d3e-4bc9-8047-1ce42b17f3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.601275 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae89a7-4d3e-4bc9-8047-1ce42b17f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.601591 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae89a7-4d3e-4bc9-8047-1ce42b17f3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.602319 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae89a7-4d3e-4bc9-8047-1ce42b17f3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:05.603947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae89a7-4d3e-4bc9-8047-1ce42b17f3e0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:05.614034 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1310/2642] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:05.618915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168ed05-f8c5-4d56-a966-dd8a82347f80 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:05.629106 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168ed05-f8c5-4d56-a966-dd8a82347f80 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:05.634731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83325-9ebf-4146-97cf-b6b633301958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:05.635901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83325-9ebf-4146-97cf-b6b633301958 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.636185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83325-9ebf-4146-97cf-b6b633301958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.636463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83325-9ebf-4146-97cf-b6b633301958 admin admin] PATH_INFO: `/v3/projects/fba569b5e72f415da82c95be9c3311d6/users/3160ee93bac4422ab30c0478ea2dcd3f/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.650786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab83325-9ebf-4146-97cf-b6b633301958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba569b5e72f415da82c95be9c3311d6, user_id=3160ee93bac4422ab30c0478ea2dcd3f, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:05.653414 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab83325-9ebf-4146-97cf-b6b633301958 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:05.666455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1333/2643] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:05 2022] PUT /identity/v3/projects/fba569b5e72f415da82c95be9c3311d6/users/3160ee93bac4422ab30c0478ea2dcd3f/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:05.678177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659dfda-8bae-4b46-acf5-755deb24a68e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.678512 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659dfda-8bae-4b46-acf5-755deb24a68e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.678799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659dfda-8bae-4b46-acf5-755deb24a68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.704479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6659dfda-8bae-4b46-acf5-755deb24a68e None None] MFA Rules not processed for user `3160ee93bac4422ab30c0478ea2dcd3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:05.705692 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6659dfda-8bae-4b46-acf5-755deb24a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:05.768549 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1311/2644] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:05.772897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83325-9ebf-4146-97cf-b6b633301958 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:05.832534 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83325-9ebf-4146-97cf-b6b633301958 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:05.837157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719a8a-c65d-465d-b3c5-09863624c68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:05.837796 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719a8a-c65d-465d-b3c5-09863624c68e admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.838081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719a8a-c65d-465d-b3c5-09863624c68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.838375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719a8a-c65d-465d-b3c5-09863624c68e admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.839061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f719a8a-c65d-465d-b3c5-09863624c68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:05.840946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f719a8a-c65d-465d-b3c5-09863624c68e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:05.866073 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1334/2645] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:05 2022] POST /identity/v3/projects => generated 401 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:05.870562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659dfda-8bae-4b46-acf5-755deb24a68e None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:05.881122 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659dfda-8bae-4b46-acf5-755deb24a68e None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:05.913998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:05.937102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc7af-0e97-4357-993c-940828058f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:05.937771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc7af-0e97-4357-993c-940828058f30 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.938064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc7af-0e97-4357-993c-940828058f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.938340 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc7af-0e97-4357-993c-940828058f30 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.939086 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fc7af-0e97-4357-993c-940828058f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:05.940994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fc7af-0e97-4357-993c-940828058f30 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:05.959993 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1312/2646] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:05 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:05.963949 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719a8a-c65d-465d-b3c5-09863624c68e admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:05.975327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719a8a-c65d-465d-b3c5-09863624c68e admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:05.980031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92dd7a-146a-4af2-8741-485e01a0a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:05.980680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92dd7a-146a-4af2-8741-485e01a0a717 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:05.980964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92dd7a-146a-4af2-8741-485e01a0a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:05.981236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92dd7a-146a-4af2-8741-485e01a0a717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:05.981958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92dd7a-146a-4af2-8741-485e01a0a717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:05.983609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92dd7a-146a-4af2-8741-485e01a0a717 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:05.995974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1335/2647] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:06.000130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc7af-0e97-4357-993c-940828058f30 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:06.010492 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc7af-0e97-4357-993c-940828058f30 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:06.015393 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9ac3b-d4dd-40ba-a54f-b3cfb3b15f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:06.016310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9ac3b-d4dd-40ba-a54f-b3cfb3b15f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:06.016590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9ac3b-d4dd-40ba-a54f-b3cfb3b15f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:06.016863 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9ac3b-d4dd-40ba-a54f-b3cfb3b15f37 admin admin] PATH_INFO: `/v3/projects/0effb0fc23c84cb4883539fd7a634630/users/6aee24b025dc43bdbf233ad9b6825e3c/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:06.033261 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9ac3b-d4dd-40ba-a54f-b3cfb3b15f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0effb0fc23c84cb4883539fd7a634630, user_id=6aee24b025dc43bdbf233ad9b6825e3c, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:06.035919 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9ac3b-d4dd-40ba-a54f-b3cfb3b15f37 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:06.049112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1313/2648] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:05 2022] PUT /identity/v3/projects/0effb0fc23c84cb4883539fd7a634630/users/6aee24b025dc43bdbf233ad9b6825e3c/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:06.053216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92dd7a-146a-4af2-8741-485e01a0a717 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:06.063221 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92dd7a-146a-4af2-8741-485e01a0a717 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:06.118532 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bf2df-0247-4596-8e14-34cb4ccbb03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:06.119455 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bf2df-0247-4596-8e14-34cb4ccbb03a admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:06.119737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bf2df-0247-4596-8e14-34cb4ccbb03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:06.120011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bf2df-0247-4596-8e14-34cb4ccbb03a admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:06.120729 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bf2df-0247-4596-8e14-34cb4ccbb03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:06.122336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bf2df-0247-4596-8e14-34cb4ccbb03a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:06.132563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1336/2649] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:06.136608 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9ac3b-d4dd-40ba-a54f-b3cfb3b15f37 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:06.147417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9ac3b-d4dd-40ba-a54f-b3cfb3b15f37 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:06.152007 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c88575-4eac-4223-ad80-b94dbf5c0567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:06.152875 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c88575-4eac-4223-ad80-b94dbf5c0567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:06.153158 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c88575-4eac-4223-ad80-b94dbf5c0567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:06.153433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c88575-4eac-4223-ad80-b94dbf5c0567 admin admin] PATH_INFO: `/v3/projects/0effb0fc23c84cb4883539fd7a634630/users/6aee24b025dc43bdbf233ad9b6825e3c/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:06.155369 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c88575-4eac-4223-ad80-b94dbf5c0567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0effb0fc23c84cb4883539fd7a634630, user_id=6aee24b025dc43bdbf233ad9b6825e3c, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:06.157964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c88575-4eac-4223-ad80-b94dbf5c0567 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:06.168572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1314/2650] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:06 2022] PUT /identity/v3/projects/0effb0fc23c84cb4883539fd7a634630/users/6aee24b025dc43bdbf233ad9b6825e3c/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:06.178511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad2e3-3615-4802-b599-87984a1a120a None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:06.178805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad2e3-3615-4802-b599-87984a1a120a None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:06.179088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad2e3-3615-4802-b599-87984a1a120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:06.205400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-1edad2e3-3615-4802-b599-87984a1a120a None None] MFA Rules not processed for user `6aee24b025dc43bdbf233ad9b6825e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:06.206644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-1edad2e3-3615-4802-b599-87984a1a120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:06.240158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:06.276421 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1337/2651] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:06.287656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c88575-4eac-4223-ad80-b94dbf5c0567 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:06.289341 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-60c88575-4eac-4223-ad80-b94dbf5c0567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:06.344609 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c88575-4eac-4223-ad80-b94dbf5c0567 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:06.348189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f88a0-d310-45c4-b53d-2e0c32721a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:06.349424 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f88a0-d310-45c4-b53d-2e0c32721a59 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:06.349718 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f88a0-d310-45c4-b53d-2e0c32721a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:06.349994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f88a0-d310-45c4-b53d-2e0c32721a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:06.358881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f88a0-d310-45c4-b53d-2e0c32721a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:06.360297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f88a0-d310-45c4-b53d-2e0c32721a59 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:06.369958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1315/2652] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:06 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:06.448439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad2e3-3615-4802-b599-87984a1a120a None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:06.459279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad2e3-3615-4802-b599-87984a1a120a None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:06.463161 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf74dd-023b-4da1-a521-a04b1b8ddaf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:06.463835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf74dd-023b-4da1-a521-a04b1b8ddaf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:06.464119 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf74dd-023b-4da1-a521-a04b1b8ddaf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:06.464399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf74dd-023b-4da1-a521-a04b1b8ddaf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:06.522333 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf74dd-023b-4da1-a521-a04b1b8ddaf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:06.523789 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf74dd-023b-4da1-a521-a04b1b8ddaf3 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:06.533183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1338/2653] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:09.915006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f88a0-d310-45c4-b53d-2e0c32721a59 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:09.916555 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-331f88a0-d310-45c4-b53d-2e0c32721a59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:09.942302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf74dd-023b-4da1-a521-a04b1b8ddaf3 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:09.944535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2ccf74dd-023b-4da1-a521-a04b1b8ddaf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:10.045813 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f88a0-d310-45c4-b53d-2e0c32721a59 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:10.050286 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf74dd-023b-4da1-a521-a04b1b8ddaf3 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:10.054629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0620a-9f5a-4655-aba2-fb13c813b412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:10.055303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0620a-9f5a-4655-aba2-fb13c813b412 service nova] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:10.055583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0620a-9f5a-4655-aba2-fb13c813b412 service nova] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:10.056011 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0620a-9f5a-4655-aba2-fb13c813b412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:10.058738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d8e0620a-9f5a-4655-aba2-fb13c813b412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:10.063758 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:10.064956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:10.065246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:10.065530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] PATH_INFO: `/v3/users/9e3d207edc24461bbe303ff037e440fa` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:10.067291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3d207edc24461bbe303ff037e440fa)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:10.069847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:10.083832 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0620a-9f5a-4655-aba2-fb13c813b412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:10.085521 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0620a-9f5a-4655-aba2-fb13c813b412 service nova] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:10.104266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1316/2654] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:10.149335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3d207edc24461bbe303ff037e440fa'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.150756 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3d207edc24461bbe303ff037e440fa'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.160653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3d207edc24461bbe303ff037e440fa'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.175190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3d207edc24461bbe303ff037e440fa'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.178094 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:10.185004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3d207edc24461bbe303ff037e440fa'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.192768 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1339/2655] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:09 2022] DELETE /identity/v3/users/9e3d207edc24461bbe303ff037e440fa => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:10.197310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0545f84-6da0-46f7-aade-5dd15bcf5b5a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:10.197610 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0545f84-6da0-46f7-aade-5dd15bcf5b5a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:10.197892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0545f84-6da0-46f7-aade-5dd15bcf5b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:10.214951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d0545f84-6da0-46f7-aade-5dd15bcf5b5a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:10.216156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d0545f84-6da0-46f7-aade-5dd15bcf5b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:10.228840 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:10.278132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1317/2656] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:10.288603 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:10.290620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:10.363156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1522d-bfe6-47d4-8c4e-5f4e49302c1b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:10.367726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68085c74-ca6d-44a1-ae45-aebae125ce87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:10.368415 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68085c74-ca6d-44a1-ae45-aebae125ce87 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:10.368702 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68085c74-ca6d-44a1-ae45-aebae125ce87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:10.369238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68085c74-ca6d-44a1-ae45-aebae125ce87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:10.379470 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68085c74-ca6d-44a1-ae45-aebae125ce87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:10.380995 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68085c74-ca6d-44a1-ae45-aebae125ce87 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:10.393356 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1340/2657] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:10.621627 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0545f84-6da0-46f7-aade-5dd15bcf5b5a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:10.623170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d0545f84-6da0-46f7-aade-5dd15bcf5b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:10.637095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0545f84-6da0-46f7-aade-5dd15bcf5b5a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:10.642618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:10.644350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:10.644584 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:10.646532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] PATH_INFO: `/v3/users/3160ee93bac4422ab30c0478ea2dcd3f` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:10.647938 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3160ee93bac4422ab30c0478ea2dcd3f)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:10.650043 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:10.706443 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3160ee93bac4422ab30c0478ea2dcd3f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.707218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3160ee93bac4422ab30c0478ea2dcd3f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.707949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3160ee93bac4422ab30c0478ea2dcd3f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.724980 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3160ee93bac4422ab30c0478ea2dcd3f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.739323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-d5923962-7de0-47a1-a61b-25e183eb52dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3160ee93bac4422ab30c0478ea2dcd3f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.744478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68085c74-ca6d-44a1-ae45-aebae125ce87 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:10.745904 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-68085c74-ca6d-44a1-ae45-aebae125ce87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:10.762710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1318/2658] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:10 2022] DELETE /identity/v3/users/3160ee93bac4422ab30c0478ea2dcd3f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:10.772814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29f37e-8fc2-47f0-aaf7-a57f681707a0 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:10.772814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29f37e-8fc2-47f0-aaf7-a57f681707a0 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:10.772814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29f37e-8fc2-47f0-aaf7-a57f681707a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:10.787419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68085c74-ca6d-44a1-ae45-aebae125ce87 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:10.789677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8d29f37e-8fc2-47f0-aaf7-a57f681707a0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:10.790914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8d29f37e-8fc2-47f0-aaf7-a57f681707a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:10.866138 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:10.867295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:10.867640 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:10.867920 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] PATH_INFO: `/v3/projects/59c1bc0eaecd49de9ff33d26aee7625d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:10.869601 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c1bc0eaecd49de9ff33d26aee7625d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:10.871630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:10.879705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1319/2659] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:43:10.891814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29f37e-8fc2-47f0-aaf7-a57f681707a0 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:10.893472 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8d29f37e-8fc2-47f0-aaf7-a57f681707a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:10.932354 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c1bc0eaecd49de9ff33d26aee7625d', 'request_id': 'req-1acb183e-bda6-4471-9f3e-4cf0216d8198'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.934891 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:10.947742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c1bc0eaecd49de9ff33d26aee7625d', 'request_id': 'req-1acb183e-bda6-4471-9f3e-4cf0216d8198'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.955964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c1bc0eaecd49de9ff33d26aee7625d', 'request_id': 'req-1acb183e-bda6-4471-9f3e-4cf0216d8198'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.972149 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] The token cache is being invalidate because project 59c1bc0eaecd49de9ff33d26aee7625d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:10.972478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.973289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1acb183e-bda6-4471-9f3e-4cf0216d8198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:10.974917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1341/2660] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:10 2022] DELETE /identity/v3/projects/59c1bc0eaecd49de9ff33d26aee7625d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:10.976181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29f37e-8fc2-47f0-aaf7-a57f681707a0 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:10.981582 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832991d-142d-44f4-8a21-c3cffabfb73d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:10.981885 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832991d-142d-44f4-8a21-c3cffabfb73d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:10.982165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832991d-142d-44f4-8a21-c3cffabfb73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.024951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f832991d-142d-44f4-8a21-c3cffabfb73d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:11.026577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f832991d-142d-44f4-8a21-c3cffabfb73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:11.046116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979502c-44c9-4e28-b481-7e7d524542e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:11.048219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979502c-44c9-4e28-b481-7e7d524542e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.048759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979502c-44c9-4e28-b481-7e7d524542e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.049524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979502c-44c9-4e28-b481-7e7d524542e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.051783 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-4979502c-44c9-4e28-b481-7e7d524542e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:11.057004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:11.117231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1342/2661] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:11.127123 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d121535-e66e-4fec-891a-d5270c128ce0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.127559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d121535-e66e-4fec-891a-d5270c128ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.127849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d121535-e66e-4fec-891a-d5270c128ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.145347 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979502c-44c9-4e28-b481-7e7d524542e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:11.147914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979502c-44c9-4e28-b481-7e7d524542e2 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:11.149232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-8d121535-e66e-4fec-891a-d5270c128ce0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:11.150481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-8d121535-e66e-4fec-891a-d5270c128ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:11.159397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1343/2662] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:43:11.160441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1320/2663] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:11.163781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d121535-e66e-4fec-891a-d5270c128ce0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:11.174222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d121535-e66e-4fec-891a-d5270c128ce0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:11.180626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c765e-ca04-4b3e-ba22-b1f86f9b7ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:11.181426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c765e-ca04-4b3e-ba22-b1f86f9b7ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.181790 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c765e-ca04-4b3e-ba22-b1f86f9b7ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.182066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c765e-ca04-4b3e-ba22-b1f86f9b7ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.182991 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c765e-ca04-4b3e-ba22-b1f86f9b7ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:11.183440 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c765e-ca04-4b3e-ba22-b1f86f9b7ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:11.185082 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c765e-ca04-4b3e-ba22-b1f86f9b7ab5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:11.203040 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1344/2664] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:43:11.207495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979502c-44c9-4e28-b481-7e7d524542e2 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:11.218602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979502c-44c9-4e28-b481-7e7d524542e2 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:11.224131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718be064-d57f-4a47-9887-495643a31c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:11.224916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be064-d57f-4a47-9887-495643a31c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.225683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be064-d57f-4a47-9887-495643a31c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.225683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be064-d57f-4a47-9887-495643a31c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.226673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718be064-d57f-4a47-9887-495643a31c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:11.228634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718be064-d57f-4a47-9887-495643a31c36 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:11.259417 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1321/2665] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:11 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:11.263720 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c765e-ca04-4b3e-ba22-b1f86f9b7ab5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:11.277025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c765e-ca04-4b3e-ba22-b1f86f9b7ab5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:11.345893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef2a30-4b77-49bb-8d45-6a597529d550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:11.346792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef2a30-4b77-49bb-8d45-6a597529d550 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.347081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef2a30-4b77-49bb-8d45-6a597529d550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.347359 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef2a30-4b77-49bb-8d45-6a597529d550 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.348102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef2a30-4b77-49bb-8d45-6a597529d550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:11.350649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef2a30-4b77-49bb-8d45-6a597529d550 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:11.375870 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1345/2666] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:11 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:43:11.379593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718be064-d57f-4a47-9887-495643a31c36 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:11.391326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718be064-d57f-4a47-9887-495643a31c36 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:11.396197 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a70824-00df-412f-9289-6c99798c3ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:11.396886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a70824-00df-412f-9289-6c99798c3ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.397176 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a70824-00df-412f-9289-6c99798c3ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.397458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a70824-00df-412f-9289-6c99798c3ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.398336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a70824-00df-412f-9289-6c99798c3ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:11.399830 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a70824-00df-412f-9289-6c99798c3ebe admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:11.413649 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1322/2667] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:43:11.421703 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef2a30-4b77-49bb-8d45-6a597529d550 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:11.432892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef2a30-4b77-49bb-8d45-6a597529d550 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:11.438696 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b63b05-0109-4c4a-99c4-72821bc354b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:11.439391 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b63b05-0109-4c4a-99c4-72821bc354b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.440177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b63b05-0109-4c4a-99c4-72821bc354b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.440177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b63b05-0109-4c4a-99c4-72821bc354b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.441003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b63b05-0109-4c4a-99c4-72821bc354b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:11.443085 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b63b05-0109-4c4a-99c4-72821bc354b2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:11.462376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1346/2668] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:11.463593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a70824-00df-412f-9289-6c99798c3ebe admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:11.473374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b63b05-0109-4c4a-99c4-72821bc354b2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:11.476068 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d4b63b05-0109-4c4a-99c4-72821bc354b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:11.477013 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a70824-00df-412f-9289-6c99798c3ebe admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:11.482468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c94474-26cd-4695-8bef-3b78991e9161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:11.483475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c94474-26cd-4695-8bef-3b78991e9161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.483763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c94474-26cd-4695-8bef-3b78991e9161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.484045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c94474-26cd-4695-8bef-3b78991e9161 admin admin] PATH_INFO: `/v3/projects/305e800eb68c48aa82a8ed3cd131cf33/users/6b89bdb2c1224697ad3dd5ea90aaf1a4/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.503522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c94474-26cd-4695-8bef-3b78991e9161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=305e800eb68c48aa82a8ed3cd131cf33, user_id=6b89bdb2c1224697ad3dd5ea90aaf1a4, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:11.506345 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c94474-26cd-4695-8bef-3b78991e9161 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:11.510194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b63b05-0109-4c4a-99c4-72821bc354b2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:11.515888 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:11.516683 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.517010 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.517236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] PATH_INFO: `/v3/projects/fba569b5e72f415da82c95be9c3311d6` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.518518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba569b5e72f415da82c95be9c3311d6)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:11.520555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:11.534773 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1323/2669] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:11 2022] PUT /identity/v3/projects/305e800eb68c48aa82a8ed3cd131cf33/users/6b89bdb2c1224697ad3dd5ea90aaf1a4/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:11.538735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cd42a-331e-4926-a7d9-74241062c988 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.539163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cd42a-331e-4926-a7d9-74241062c988 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.539548 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cd42a-331e-4926-a7d9-74241062c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.571523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-eb2cd42a-331e-4926-a7d9-74241062c988 None None] MFA Rules not processed for user `6b89bdb2c1224697ad3dd5ea90aaf1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:11.576112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-eb2cd42a-331e-4926-a7d9-74241062c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:11.585605 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba569b5e72f415da82c95be9c3311d6', 'request_id': 'req-75ef0dff-997a-4281-9311-9407746d2ee4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:11.605126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba569b5e72f415da82c95be9c3311d6', 'request_id': 'req-75ef0dff-997a-4281-9311-9407746d2ee4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:11.613404 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba569b5e72f415da82c95be9c3311d6', 'request_id': 'req-75ef0dff-997a-4281-9311-9407746d2ee4'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:11.626588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] The token cache is being invalidate because project fba569b5e72f415da82c95be9c3311d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:11.626804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:11.627489 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:11.629116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1347/2670] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:11 2022] DELETE /identity/v3/projects/fba569b5e72f415da82c95be9c3311d6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:11.634616 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:11.639703 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:11.643865 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:11.650417 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:11.687130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1324/2671] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:11.698880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cd42a-331e-4926-a7d9-74241062c988 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:11.700947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-eb2cd42a-331e-4926-a7d9-74241062c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:11.728345 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef0dff-997a-4281-9311-9407746d2ee4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:11.733113 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:11.734396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.734396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.734832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] PATH_INFO: `/v3/users/6aee24b025dc43bdbf233ad9b6825e3c` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.736252 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aee24b025dc43bdbf233ad9b6825e3c)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:11.738224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:11.771166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cd42a-331e-4926-a7d9-74241062c988 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:11.775922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137af7-fa9c-4fe2-a865-95fc447ba6c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:11.776687 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137af7-fa9c-4fe2-a865-95fc447ba6c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:11.776989 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137af7-fa9c-4fe2-a865-95fc447ba6c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:11.777268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137af7-fa9c-4fe2-a865-95fc447ba6c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:11.787862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35137af7-fa9c-4fe2-a865-95fc447ba6c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:11.789230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aee24b025dc43bdbf233ad9b6825e3c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:11.789430 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35137af7-fa9c-4fe2-a865-95fc447ba6c7 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:11.789940 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aee24b025dc43bdbf233ad9b6825e3c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:11.798682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aee24b025dc43bdbf233ad9b6825e3c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:11.799081 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1325/2672] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:11.811599 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aee24b025dc43bdbf233ad9b6825e3c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:11.819623 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-6276a406-cd88-4a38-a0d0-eb245dc896c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aee24b025dc43bdbf233ad9b6825e3c'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:11.826899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1348/2673] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:11 2022] DELETE /identity/v3/users/6aee24b025dc43bdbf233ad9b6825e3c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:12.126003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137af7-fa9c-4fe2-a865-95fc447ba6c7 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:12.141780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137af7-fa9c-4fe2-a865-95fc447ba6c7 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:12.202957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:12.203736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.204022 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.204303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] PATH_INFO: `/v3/projects/0effb0fc23c84cb4883539fd7a634630` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.205473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0effb0fc23c84cb4883539fd7a634630)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:12.207409 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:12.253089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0effb0fc23c84cb4883539fd7a634630', 'request_id': 'req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:12.258704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0effb0fc23c84cb4883539fd7a634630', 'request_id': 'req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:12.264740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0effb0fc23c84cb4883539fd7a634630', 'request_id': 'req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:12.277364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] The token cache is being invalidate because project 0effb0fc23c84cb4883539fd7a634630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:12.277655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:12.278305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-0bfec89d-a9ce-4f76-818f-cbf03a6a60f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:12.279847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1326/2674] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:12 2022] DELETE /identity/v3/projects/0effb0fc23c84cb4883539fd7a634630 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:12.284863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c572120-341a-46d0-9ae8-38dabfa75c41 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.285320 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c572120-341a-46d0-9ae8-38dabfa75c41 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.285447 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c572120-341a-46d0-9ae8-38dabfa75c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.303584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-4c572120-341a-46d0-9ae8-38dabfa75c41 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:12.304786 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4c572120-341a-46d0-9ae8-38dabfa75c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:12.363872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1349/2675] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:12.372012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316792ad-37fc-4717-b3ff-32e58aa7904d None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.372373 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316792ad-37fc-4717-b3ff-32e58aa7904d None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.372660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316792ad-37fc-4717-b3ff-32e58aa7904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.378988 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:12.393193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-316792ad-37fc-4717-b3ff-32e58aa7904d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:12.394435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-316792ad-37fc-4717-b3ff-32e58aa7904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:12.404752 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1327/2676] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:12.408555 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c572120-341a-46d0-9ae8-38dabfa75c41 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:12.421833 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c572120-341a-46d0-9ae8-38dabfa75c41 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:12.426798 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab09f0-f823-4df8-8184-e550a1130cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:12.427463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab09f0-f823-4df8-8184-e550a1130cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.427746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab09f0-f823-4df8-8184-e550a1130cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.428025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab09f0-f823-4df8-8184-e550a1130cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.428748 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab09f0-f823-4df8-8184-e550a1130cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:12.429058 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab09f0-f823-4df8-8184-e550a1130cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:12.430726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab09f0-f823-4df8-8184-e550a1130cd5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:12.443339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1350/2677] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:12.447545 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316792ad-37fc-4717-b3ff-32e58aa7904d None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:12.459291 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316792ad-37fc-4717-b3ff-32e58aa7904d None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:12.463998 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9be70-ccec-4daa-b6e9-f8300da6cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:12.464642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9be70-ccec-4daa-b6e9-f8300da6cb9e admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.464925 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9be70-ccec-4daa-b6e9-f8300da6cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.465201 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9be70-ccec-4daa-b6e9-f8300da6cb9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.465897 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9be70-ccec-4daa-b6e9-f8300da6cb9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:12.467821 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9be70-ccec-4daa-b6e9-f8300da6cb9e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:12.492267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1328/2678] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:12 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:12.496561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab09f0-f823-4df8-8184-e550a1130cd5 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:12.507043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab09f0-f823-4df8-8184-e550a1130cd5 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:12.514612 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:12.563476 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17f16d-4209-465f-ac28-6fefff2298d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:12.564148 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17f16d-4209-465f-ac28-6fefff2298d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.564436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17f16d-4209-465f-ac28-6fefff2298d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.564714 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17f16d-4209-465f-ac28-6fefff2298d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.565416 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17f16d-4209-465f-ac28-6fefff2298d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:12.567879 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17f16d-4209-465f-ac28-6fefff2298d7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:12.591818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1351/2679] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:12 2022] POST /identity/v3/users => generated 304 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:12.593446 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9be70-ccec-4daa-b6e9-f8300da6cb9e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:12.604217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9be70-ccec-4daa-b6e9-f8300da6cb9e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:12.609136 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a295f0c-33c9-45e8-a30e-4fde488feba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:12.609853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a295f0c-33c9-45e8-a30e-4fde488feba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.610146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a295f0c-33c9-45e8-a30e-4fde488feba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.610509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a295f0c-33c9-45e8-a30e-4fde488feba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.611230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a295f0c-33c9-45e8-a30e-4fde488feba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:12.612803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a295f0c-33c9-45e8-a30e-4fde488feba2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:12.624583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1329/2680] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:43:12.628608 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17f16d-4209-465f-ac28-6fefff2298d7 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:12.638588 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17f16d-4209-465f-ac28-6fefff2298d7 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:12.643192 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23315542-c2e4-466c-bc14-df5a7d0fc9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:12.643844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23315542-c2e4-466c-bc14-df5a7d0fc9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.644128 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23315542-c2e4-466c-bc14-df5a7d0fc9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.644406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23315542-c2e4-466c-bc14-df5a7d0fc9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.645127 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23315542-c2e4-466c-bc14-df5a7d0fc9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:12.646764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23315542-c2e4-466c-bc14-df5a7d0fc9d9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:12.656597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1352/2681] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:12.660468 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a295f0c-33c9-45e8-a30e-4fde488feba2 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:12.671064 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a295f0c-33c9-45e8-a30e-4fde488feba2 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:12.676101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c2e40-8852-44aa-9af9-b8f96b99b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:12.677557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2e40-8852-44aa-9af9-b8f96b99b5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.677841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2e40-8852-44aa-9af9-b8f96b99b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.678116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2e40-8852-44aa-9af9-b8f96b99b5c2 admin admin] PATH_INFO: `/v3/projects/78eaccc58608440c90e8096b3ffc2054/users/786918290de04a3b9268682dcf2a12d7/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.692589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c2e40-8852-44aa-9af9-b8f96b99b5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78eaccc58608440c90e8096b3ffc2054, user_id=786918290de04a3b9268682dcf2a12d7, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:12.695292 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c2e40-8852-44aa-9af9-b8f96b99b5c2 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:12.708074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1330/2682] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:12 2022] PUT /identity/v3/projects/78eaccc58608440c90e8096b3ffc2054/users/786918290de04a3b9268682dcf2a12d7/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:12.719044 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f44537-5dca-4fee-bfc5-ebfa6b7ef8be None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.719275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f44537-5dca-4fee-bfc5-ebfa6b7ef8be None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.719554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f44537-5dca-4fee-bfc5-ebfa6b7ef8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.747381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-52f44537-5dca-4fee-bfc5-ebfa6b7ef8be None None] MFA Rules not processed for user `786918290de04a3b9268682dcf2a12d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:12.748136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-52f44537-5dca-4fee-bfc5-ebfa6b7ef8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:12.818446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1353/2683] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:12.822990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c2e40-8852-44aa-9af9-b8f96b99b5c2 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:12.890601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c2e40-8852-44aa-9af9-b8f96b99b5c2 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:12.893673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f859-9cc7-445a-9a69-2158e34aa502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:12.894346 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f859-9cc7-445a-9a69-2158e34aa502 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:12.894728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f859-9cc7-445a-9a69-2158e34aa502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:12.895021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f859-9cc7-445a-9a69-2158e34aa502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:12.896238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11f859-9cc7-445a-9a69-2158e34aa502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:12.898180 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11f859-9cc7-445a-9a69-2158e34aa502 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:12.925352 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1331/2684] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:12 2022] POST /identity/v3/projects => generated 409 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:12.929960 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f44537-5dca-4fee-bfc5-ebfa6b7ef8be None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:12.941255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f44537-5dca-4fee-bfc5-ebfa6b7ef8be None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:12.999469 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede092b5-fa51-4f76-93a8-d74a090798b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:13.000210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede092b5-fa51-4f76-93a8-d74a090798b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:13.000498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede092b5-fa51-4f76-93a8-d74a090798b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:13.000778 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede092b5-fa51-4f76-93a8-d74a090798b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:13.001537 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede092b5-fa51-4f76-93a8-d74a090798b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:13.003525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede092b5-fa51-4f76-93a8-d74a090798b4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:13.023884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1354/2685] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:12 2022] POST /identity/v3/users => generated 311 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:43:13.027908 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f859-9cc7-445a-9a69-2158e34aa502 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:13.040195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f859-9cc7-445a-9a69-2158e34aa502 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:13.046327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad43e-8003-4b80-a95c-6f938dadd233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:13.047147 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad43e-8003-4b80-a95c-6f938dadd233 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:13.047667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad43e-8003-4b80-a95c-6f938dadd233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:13.048073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad43e-8003-4b80-a95c-6f938dadd233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:13.048799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad43e-8003-4b80-a95c-6f938dadd233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:13.050397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad43e-8003-4b80-a95c-6f938dadd233 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:13.061524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1332/2686] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:13.065673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede092b5-fa51-4f76-93a8-d74a090798b4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:13.076586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede092b5-fa51-4f76-93a8-d74a090798b4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:13.081810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfebd1-f1c2-4eb5-a2ac-baec8147972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:13.082746 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfebd1-f1c2-4eb5-a2ac-baec8147972b admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:13.083536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfebd1-f1c2-4eb5-a2ac-baec8147972b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:13.083810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfebd1-f1c2-4eb5-a2ac-baec8147972b admin admin] PATH_INFO: `/v3/projects/722920b3dc0845c78eda55abafae0188/users/597ae0521f8a47c3a685a07620b0993b/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:13.086949 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:13.099894 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfebd1-f1c2-4eb5-a2ac-baec8147972b admin admin] RBAC: Authorizing `identity:create_grant(project_id=722920b3dc0845c78eda55abafae0188, user_id=597ae0521f8a47c3a685a07620b0993b, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:13.102553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfebd1-f1c2-4eb5-a2ac-baec8147972b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:13.116552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1355/2687] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:13 2022] PUT /identity/v3/projects/722920b3dc0845c78eda55abafae0188/users/597ae0521f8a47c3a685a07620b0993b/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:13.120817 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad43e-8003-4b80-a95c-6f938dadd233 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:13.131289 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad43e-8003-4b80-a95c-6f938dadd233 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:13.194530 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a74e57-46af-4864-84c5-e655ebb38614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:13.195217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74e57-46af-4864-84c5-e655ebb38614 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:13.195499 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74e57-46af-4864-84c5-e655ebb38614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:13.195782 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74e57-46af-4864-84c5-e655ebb38614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:13.196519 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a74e57-46af-4864-84c5-e655ebb38614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:13.198173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a74e57-46af-4864-84c5-e655ebb38614 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:13.210097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1333/2688] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:13.214158 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfebd1-f1c2-4eb5-a2ac-baec8147972b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:13.225195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfebd1-f1c2-4eb5-a2ac-baec8147972b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:13.230765 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77f3f7-622b-4ca6-81be-8094c2847a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:13.231694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f3f7-622b-4ca6-81be-8094c2847a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:13.231978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f3f7-622b-4ca6-81be-8094c2847a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:13.232259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f3f7-622b-4ca6-81be-8094c2847a12 admin admin] PATH_INFO: `/v3/projects/722920b3dc0845c78eda55abafae0188/users/597ae0521f8a47c3a685a07620b0993b/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:13.234321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77f3f7-622b-4ca6-81be-8094c2847a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722920b3dc0845c78eda55abafae0188, user_id=597ae0521f8a47c3a685a07620b0993b, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:13.237063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77f3f7-622b-4ca6-81be-8094c2847a12 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:13.249238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1356/2689] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:13 2022] PUT /identity/v3/projects/722920b3dc0845c78eda55abafae0188/users/597ae0521f8a47c3a685a07620b0993b/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:13.260315 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d7f01-3ef6-489b-83ad-0c7e24425c29 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:13.260620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d7f01-3ef6-489b-83ad-0c7e24425c29 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:13.260961 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d7f01-3ef6-489b-83ad-0c7e24425c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:13.280297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:13.290623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-924d7f01-3ef6-489b-83ad-0c7e24425c29 None None] MFA Rules not processed for user `597ae0521f8a47c3a685a07620b0993b`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:13.291846 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-924d7f01-3ef6-489b-83ad-0c7e24425c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:13.360246 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1334/2690] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:13.371964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77f3f7-622b-4ca6-81be-8094c2847a12 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:13.373694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dc77f3f7-622b-4ca6-81be-8094c2847a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:13.447162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77f3f7-622b-4ca6-81be-8094c2847a12 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:13.447494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c47791-1870-4f86-8742-844ff0772aa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:13.448065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c47791-1870-4f86-8742-844ff0772aa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:13.448524 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c47791-1870-4f86-8742-844ff0772aa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:13.448879 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c47791-1870-4f86-8742-844ff0772aa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:13.463071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c47791-1870-4f86-8742-844ff0772aa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:13.464740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c47791-1870-4f86-8742-844ff0772aa6 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:13.475734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1357/2691] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:13.627870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d7f01-3ef6-489b-83ad-0c7e24425c29 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:13.638047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d7f01-3ef6-489b-83ad-0c7e24425c29 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:13.641577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e6423-f289-4e1d-b80a-0f8fccab362e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:13.642210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e6423-f289-4e1d-b80a-0f8fccab362e service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:13.642540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e6423-f289-4e1d-b80a-0f8fccab362e service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:13.642822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e6423-f289-4e1d-b80a-0f8fccab362e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:13.699509 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e6423-f289-4e1d-b80a-0f8fccab362e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:13.700942 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e6423-f289-4e1d-b80a-0f8fccab362e service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:13.710006 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1335/2692] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:14.067798 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c47791-1870-4f86-8742-844ff0772aa6 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:14.069757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c6c47791-1870-4f86-8742-844ff0772aa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:14.130063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c47791-1870-4f86-8742-844ff0772aa6 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:14.133619 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d02c6-3b13-4323-9540-2a2c25b91e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:14.134269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d02c6-3b13-4323-9540-2a2c25b91e19 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:14.134583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d02c6-3b13-4323-9540-2a2c25b91e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:14.134863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d02c6-3b13-4323-9540-2a2c25b91e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:14.136630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ed9d02c6-3b13-4323-9540-2a2c25b91e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:14.198994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d02c6-3b13-4323-9540-2a2c25b91e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:14.200436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d02c6-3b13-4323-9540-2a2c25b91e19 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:14.210419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1358/2693] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:17.276350 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e6423-f289-4e1d-b80a-0f8fccab362e service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:17.277777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-9d3e6423-f289-4e1d-b80a-0f8fccab362e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:17.296889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e6423-f289-4e1d-b80a-0f8fccab362e service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:17.301390 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:17.304110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:17.304110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:17.304110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] PATH_INFO: `/v3/users/4a4e638dc0dd459699b76df35568e795` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:17.318763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4e638dc0dd459699b76df35568e795)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:17.320697 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:17.369721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4e638dc0dd459699b76df35568e795'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:17.370397 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4e638dc0dd459699b76df35568e795'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:17.371015 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4e638dc0dd459699b76df35568e795'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:17.383927 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4e638dc0dd459699b76df35568e795'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:17.400765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-09c3f0ad-be20-42c0-8acc-609387733562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4e638dc0dd459699b76df35568e795'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:17.405570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:17.420851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1336/2694] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:17 2022] DELETE /identity/v3/users/4a4e638dc0dd459699b76df35568e795 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:17.602617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d02c6-3b13-4323-9540-2a2c25b91e19 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:17.623363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d02c6-3b13-4323-9540-2a2c25b91e19 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:17.649368 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:17.697980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:17.698901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:17.699195 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:17.699470 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] PATH_INFO: `/v3/projects/5689d68ff6b945a995f3c6a57f00d8d8` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:17.711006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5689d68ff6b945a995f3c6a57f00d8d8)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:17.713333 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:17.764936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5689d68ff6b945a995f3c6a57f00d8d8', 'request_id': 'req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:17.773484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5689d68ff6b945a995f3c6a57f00d8d8', 'request_id': 'req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:17.783173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5689d68ff6b945a995f3c6a57f00d8d8', 'request_id': 'req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:17.795496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] The token cache is being invalidate because project 5689d68ff6b945a995f3c6a57f00d8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:17.795783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:17.796422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-3cf5a8f8-1954-471b-857e-cc4122c2f1bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:17.797950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1359/2695] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:17 2022] DELETE /identity/v3/projects/5689d68ff6b945a995f3c6a57f00d8d8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:17.802945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4d56f-ea42-4bb0-8721-1ac967cd6033 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:17.803310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4d56f-ea42-4bb0-8721-1ac967cd6033 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:17.803749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4d56f-ea42-4bb0-8721-1ac967cd6033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:17.822452 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a1f4d56f-ea42-4bb0-8721-1ac967cd6033 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:17.823788 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a1f4d56f-ea42-4bb0-8721-1ac967cd6033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:17.894380 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1337/2696] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:17.902583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797f984-488b-4380-a779-5ef0ed55a3e3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:17.902880 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797f984-488b-4380-a779-5ef0ed55a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:17.903164 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797f984-488b-4380-a779-5ef0ed55a3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:17.923985 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a797f984-488b-4380-a779-5ef0ed55a3e3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:17.925255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a797f984-488b-4380-a779-5ef0ed55a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:17.933275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1360/2697] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:17.937518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4d56f-ea42-4bb0-8721-1ac967cd6033 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:17.947331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4d56f-ea42-4bb0-8721-1ac967cd6033 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:17.951949 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139933b-1230-45ff-bfac-47c8f5de7a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:17.952606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139933b-1230-45ff-bfac-47c8f5de7a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:17.952894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139933b-1230-45ff-bfac-47c8f5de7a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:17.953181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139933b-1230-45ff-bfac-47c8f5de7a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:17.953974 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139933b-1230-45ff-bfac-47c8f5de7a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:17.954216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139933b-1230-45ff-bfac-47c8f5de7a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:17.956549 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139933b-1230-45ff-bfac-47c8f5de7a5c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:17.970634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1338/2698] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:17.976842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797f984-488b-4380-a779-5ef0ed55a3e3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:17.988223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797f984-488b-4380-a779-5ef0ed55a3e3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:17.993478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb063aa-83ab-409d-8578-2d62b97c08d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:17.994468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb063aa-83ab-409d-8578-2d62b97c08d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:17.994752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb063aa-83ab-409d-8578-2d62b97c08d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:17.995031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb063aa-83ab-409d-8578-2d62b97c08d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:17.995747 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb063aa-83ab-409d-8578-2d62b97c08d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:17.997650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb063aa-83ab-409d-8578-2d62b97c08d1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.023901 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1361/2699] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:17 2022] POST /identity/v3/projects => generated 357 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:18.028036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139933b-1230-45ff-bfac-47c8f5de7a5c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.038613 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139933b-1230-45ff-bfac-47c8f5de7a5c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.094663 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578eff7-5237-4f9a-a844-413db1f5260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.095333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578eff7-5237-4f9a-a844-413db1f5260d admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.095622 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578eff7-5237-4f9a-a844-413db1f5260d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.095904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578eff7-5237-4f9a-a844-413db1f5260d admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.096598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578eff7-5237-4f9a-a844-413db1f5260d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.099113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578eff7-5237-4f9a-a844-413db1f5260d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.117753 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1339/2700] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:18 2022] POST /identity/v3/users => generated 279 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:18.121982 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb063aa-83ab-409d-8578-2d62b97c08d1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.132807 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb063aa-83ab-409d-8578-2d62b97c08d1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.137381 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32d745-f092-406f-b6a1-741d033d330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.138033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32d745-f092-406f-b6a1-741d033d330b admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.138319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32d745-f092-406f-b6a1-741d033d330b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.138625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32d745-f092-406f-b6a1-741d033d330b admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.139348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32d745-f092-406f-b6a1-741d033d330b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.140936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32d745-f092-406f-b6a1-741d033d330b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.151407 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1362/2701] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:18.155110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578eff7-5237-4f9a-a844-413db1f5260d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.165271 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578eff7-5237-4f9a-a844-413db1f5260d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.170082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d72cd0-33f2-4b86-83d9-42c30d845499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.170779 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72cd0-33f2-4b86-83d9-42c30d845499 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.171065 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72cd0-33f2-4b86-83d9-42c30d845499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.171375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72cd0-33f2-4b86-83d9-42c30d845499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.172125 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d72cd0-33f2-4b86-83d9-42c30d845499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.174002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d72cd0-33f2-4b86-83d9-42c30d845499 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.187029 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1340/2702] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:18.188375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32d745-f092-406f-b6a1-741d033d330b admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.198968 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32d745-f092-406f-b6a1-741d033d330b admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.203754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9520a-096d-4083-b51f-88d6ebbc9dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.204722 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9520a-096d-4083-b51f-88d6ebbc9dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.205080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9520a-096d-4083-b51f-88d6ebbc9dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.205362 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9520a-096d-4083-b51f-88d6ebbc9dc0 admin admin] PATH_INFO: `/v3/projects/29cd9797e56e4f6ea71eff73a2a12438/users/cd89e14205ab43ed8142e8977f1a5260/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.221319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9520a-096d-4083-b51f-88d6ebbc9dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cd9797e56e4f6ea71eff73a2a12438, user_id=cd89e14205ab43ed8142e8977f1a5260, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.224728 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9520a-096d-4083-b51f-88d6ebbc9dc0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.237377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1363/2703] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:18 2022] PUT /identity/v3/projects/29cd9797e56e4f6ea71eff73a2a12438/users/cd89e14205ab43ed8142e8977f1a5260/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:18.250566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046c30-280b-40a4-82df-01873ce5c747 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.250964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046c30-280b-40a4-82df-01873ce5c747 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.251343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046c30-280b-40a4-82df-01873ce5c747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.278655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-1d046c30-280b-40a4-82df-01873ce5c747 None None] MFA Rules not processed for user `cd89e14205ab43ed8142e8977f1a5260`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:18.279864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1d046c30-280b-40a4-82df-01873ce5c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:18.328314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:18.348063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1341/2704] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:18 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:18.352651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9520a-096d-4083-b51f-88d6ebbc9dc0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.398272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:18.416574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9520a-096d-4083-b51f-88d6ebbc9dc0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.421169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33044979-215d-4620-a8c6-0d904e309d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.421819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33044979-215d-4620-a8c6-0d904e309d8c admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.422103 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33044979-215d-4620-a8c6-0d904e309d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.422403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33044979-215d-4620-a8c6-0d904e309d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.423088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33044979-215d-4620-a8c6-0d904e309d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.424974 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33044979-215d-4620-a8c6-0d904e309d8c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.450676 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1364/2705] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:18 2022] POST /identity/v3/projects => generated 353 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:18.455036 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d046c30-280b-40a4-82df-01873ce5c747 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.468024 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d046c30-280b-40a4-82df-01873ce5c747 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.523617 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029968e-8d36-4789-b7a4-2d4411dd9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.524277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029968e-8d36-4789-b7a4-2d4411dd9217 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.524562 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029968e-8d36-4789-b7a4-2d4411dd9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.524838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029968e-8d36-4789-b7a4-2d4411dd9217 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.525522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029968e-8d36-4789-b7a4-2d4411dd9217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.527525 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029968e-8d36-4789-b7a4-2d4411dd9217 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.546338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1342/2706] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:18 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:43:18.550297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33044979-215d-4620-a8c6-0d904e309d8c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.561072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33044979-215d-4620-a8c6-0d904e309d8c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.565944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1ac2b-4a30-4780-974f-bb70b1dc8433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.566689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1ac2b-4a30-4780-974f-bb70b1dc8433 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.566922 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1ac2b-4a30-4780-974f-bb70b1dc8433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.567196 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1ac2b-4a30-4780-974f-bb70b1dc8433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.568540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1ac2b-4a30-4780-974f-bb70b1dc8433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.570142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1ac2b-4a30-4780-974f-bb70b1dc8433 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.580958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1365/2707] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:18.585166 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029968e-8d36-4789-b7a4-2d4411dd9217 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.595051 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029968e-8d36-4789-b7a4-2d4411dd9217 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.599745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acd343-b06e-4db6-ab5f-03628c745a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.600606 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd343-b06e-4db6-ab5f-03628c745a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.600884 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd343-b06e-4db6-ab5f-03628c745a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.601153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd343-b06e-4db6-ab5f-03628c745a0e admin admin] PATH_INFO: `/v3/projects/3f2a265abc7f41e5b1c204f6fe874ee1/users/17659eb96adb4210a9305b46d9620cf9/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.616377 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acd343-b06e-4db6-ab5f-03628c745a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2a265abc7f41e5b1c204f6fe874ee1, user_id=17659eb96adb4210a9305b46d9620cf9, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.619301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acd343-b06e-4db6-ab5f-03628c745a0e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.632206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1343/2708] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:18 2022] PUT /identity/v3/projects/3f2a265abc7f41e5b1c204f6fe874ee1/users/17659eb96adb4210a9305b46d9620cf9/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:18.636139 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1ac2b-4a30-4780-974f-bb70b1dc8433 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.646114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1ac2b-4a30-4780-974f-bb70b1dc8433 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.701488 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75bac8-1188-4cc3-8b6b-46d269bdd0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.702085 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75bac8-1188-4cc3-8b6b-46d269bdd0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.702409 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75bac8-1188-4cc3-8b6b-46d269bdd0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.702695 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75bac8-1188-4cc3-8b6b-46d269bdd0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.703429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75bac8-1188-4cc3-8b6b-46d269bdd0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.705055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75bac8-1188-4cc3-8b6b-46d269bdd0a7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.714907 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1366/2709] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:18.719181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acd343-b06e-4db6-ab5f-03628c745a0e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.729392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acd343-b06e-4db6-ab5f-03628c745a0e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.734157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d536451-1c2a-4af5-a939-442f094fce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.735084 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d536451-1c2a-4af5-a939-442f094fce24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.735370 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d536451-1c2a-4af5-a939-442f094fce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.735648 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d536451-1c2a-4af5-a939-442f094fce24 admin admin] PATH_INFO: `/v3/projects/3f2a265abc7f41e5b1c204f6fe874ee1/users/17659eb96adb4210a9305b46d9620cf9/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.737676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d536451-1c2a-4af5-a939-442f094fce24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2a265abc7f41e5b1c204f6fe874ee1, user_id=17659eb96adb4210a9305b46d9620cf9, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.740937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d536451-1c2a-4af5-a939-442f094fce24 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.751395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1344/2710] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:18 2022] PUT /identity/v3/projects/3f2a265abc7f41e5b1c204f6fe874ee1/users/17659eb96adb4210a9305b46d9620cf9/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:18.762635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cef71-d26a-45f5-ba3e-ba0c17aca16c None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.762635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cef71-d26a-45f5-ba3e-ba0c17aca16c None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.762635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cef71-d26a-45f5-ba3e-ba0c17aca16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.790031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-ef5cef71-d26a-45f5-ba3e-ba0c17aca16c None None] MFA Rules not processed for user `17659eb96adb4210a9305b46d9620cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:18.791265 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-ef5cef71-d26a-45f5-ba3e-ba0c17aca16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:18.865570 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1367/2711] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:18 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:18.876934 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d536451-1c2a-4af5-a939-442f094fce24 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:18.878713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6d536451-1c2a-4af5-a939-442f094fce24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:18.937276 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d536451-1c2a-4af5-a939-442f094fce24 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:18.940911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bce3d-da4e-4d29-b6b2-7264dcb02ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:18.941571 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bce3d-da4e-4d29-b6b2-7264dcb02ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:18.941853 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bce3d-da4e-4d29-b6b2-7264dcb02ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:18.942132 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bce3d-da4e-4d29-b6b2-7264dcb02ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:18.950988 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bce3d-da4e-4d29-b6b2-7264dcb02ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:18.952457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bce3d-da4e-4d29-b6b2-7264dcb02ee8 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:18.961861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1345/2712] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:18 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:19.033889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cef71-d26a-45f5-ba3e-ba0c17aca16c None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:19.044760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cef71-d26a-45f5-ba3e-ba0c17aca16c None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:19.048650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318bfe-4d07-4a4f-9959-2e965e335a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:19.049326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318bfe-4d07-4a4f-9959-2e965e335a58 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:19.049614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318bfe-4d07-4a4f-9959-2e965e335a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:19.049897 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318bfe-4d07-4a4f-9959-2e965e335a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:19.064932 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bce3d-da4e-4d29-b6b2-7264dcb02ee8 service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:19.066512 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b74bce3d-da4e-4d29-b6b2-7264dcb02ee8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:19.086347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:19.111969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318bfe-4d07-4a4f-9959-2e965e335a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:19.113521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318bfe-4d07-4a4f-9959-2e965e335a58 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:19.116656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:19.124318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1368/2713] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:19 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:19.137003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bce3d-da4e-4d29-b6b2-7264dcb02ee8 service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:19.142014 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:19.142956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:19.143241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:19.143516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] PATH_INFO: `/v3/users/786918290de04a3b9268682dcf2a12d7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:19.144703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=786918290de04a3b9268682dcf2a12d7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:19.146729 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:19.197462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '786918290de04a3b9268682dcf2a12d7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.198256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '786918290de04a3b9268682dcf2a12d7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.199053 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '786918290de04a3b9268682dcf2a12d7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.212851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '786918290de04a3b9268682dcf2a12d7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.225190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '786918290de04a3b9268682dcf2a12d7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.240226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1346/2714] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:19 2022] DELETE /identity/v3/users/786918290de04a3b9268682dcf2a12d7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:19.245087 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa81df-ee0b-4807-99d3-1d26b80ac21f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:19.245423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa81df-ee0b-4807-99d3-1d26b80ac21f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:19.245820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa81df-ee0b-4807-99d3-1d26b80ac21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:19.271862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-84aa81df-ee0b-4807-99d3-1d26b80ac21f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:19.273141 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-84aa81df-ee0b-4807-99d3-1d26b80ac21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:19.333669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1369/2715] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:19.343349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:19.344768 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:19.402487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f268e40-4b48-4a57-9367-fe0c91994a2a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:19.406103 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ee87-b80e-4905-8cdc-71e07a85a74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:19.406766 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ee87-b80e-4905-8cdc-71e07a85a74b service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:19.407049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ee87-b80e-4905-8cdc-71e07a85a74b service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:19.407324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ee87-b80e-4905-8cdc-71e07a85a74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:19.417763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0ee87-b80e-4905-8cdc-71e07a85a74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:19.419738 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0ee87-b80e-4905-8cdc-71e07a85a74b service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:19.430680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1347/2716] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:19.710422 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa81df-ee0b-4807-99d3-1d26b80ac21f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:19.711937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-84aa81df-ee0b-4807-99d3-1d26b80ac21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:19.728561 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa81df-ee0b-4807-99d3-1d26b80ac21f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:19.734259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:19.735146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:19.735494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:19.735813 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] PATH_INFO: `/v3/projects/78eaccc58608440c90e8096b3ffc2054` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:19.736947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78eaccc58608440c90e8096b3ffc2054)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:19.738977 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:19.786651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78eaccc58608440c90e8096b3ffc2054', 'request_id': 'req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.794105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78eaccc58608440c90e8096b3ffc2054', 'request_id': 'req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.799618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78eaccc58608440c90e8096b3ffc2054', 'request_id': 'req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.810892 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] The token cache is being invalidate because project 78eaccc58608440c90e8096b3ffc2054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:19.811175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.811792 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.813295 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1370/2717] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:19 2022] DELETE /identity/v3/projects/78eaccc58608440c90e8096b3ffc2054 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:19.817348 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ee87-b80e-4905-8cdc-71e07a85a74b service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:19.827254 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ee87-b80e-4905-8cdc-71e07a85a74b service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:19.886801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:19.887815 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:19.887951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:19.888230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] PATH_INFO: `/v3/users/597ae0521f8a47c3a685a07620b0993b` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:19.889447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=597ae0521f8a47c3a685a07620b0993b)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:19.891412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:19.896995 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:19.944647 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597ae0521f8a47c3a685a07620b0993b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.945303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597ae0521f8a47c3a685a07620b0993b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.945907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597ae0521f8a47c3a685a07620b0993b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.957484 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597ae0521f8a47c3a685a07620b0993b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.964629 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-17b76be9-f22e-49c0-a3d2-faef06a9fbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597ae0521f8a47c3a685a07620b0993b'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:19.977762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1348/2718] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:19 2022] DELETE /identity/v3/users/597ae0521f8a47c3a685a07620b0993b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:20.250249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:20.251918 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:20.264951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab85f5-7af8-489d-aa7e-b26ef460f7f6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:20.328969 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:20.329890 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.330122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.330424 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] PATH_INFO: `/v3/projects/722920b3dc0845c78eda55abafae0188` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.331613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=722920b3dc0845c78eda55abafae0188)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:20.334434 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:20.336300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:20.390081 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722920b3dc0845c78eda55abafae0188', 'request_id': 'req-03b126ec-5941-41cb-81d6-2161d36eb484'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:20.399290 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722920b3dc0845c78eda55abafae0188', 'request_id': 'req-03b126ec-5941-41cb-81d6-2161d36eb484'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:20.409264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722920b3dc0845c78eda55abafae0188', 'request_id': 'req-03b126ec-5941-41cb-81d6-2161d36eb484'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:20.418220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] The token cache is being invalidate because project 722920b3dc0845c78eda55abafae0188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:20.418539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:20.419196 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-03b126ec-5941-41cb-81d6-2161d36eb484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:20.421060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1371/2719] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:20 2022] DELETE /identity/v3/projects/722920b3dc0845c78eda55abafae0188 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:20.425968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4911cc-a439-49f4-94a3-d58c828287dc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.426488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4911cc-a439-49f4-94a3-d58c828287dc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.426634 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4911cc-a439-49f4-94a3-d58c828287dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.453595 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-cc4911cc-a439-49f4-94a3-d58c828287dc None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:20.455001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cc4911cc-a439-49f4-94a3-d58c828287dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:20.520204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1349/2720] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:20.528549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7837-f745-4b29-9637-72ff49f63d3f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.528842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7837-f745-4b29-9637-72ff49f63d3f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.529125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7837-f745-4b29-9637-72ff49f63d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.547100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-db6f7837-f745-4b29-9637-72ff49f63d3f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:20.548294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-db6f7837-f745-4b29-9637-72ff49f63d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:20.556091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1372/2721] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:43:20.560303 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4911cc-a439-49f4-94a3-d58c828287dc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:20.570903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4911cc-a439-49f4-94a3-d58c828287dc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:20.575551 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac6ea7-a876-4932-a0ce-eb1a8965102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:20.576205 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac6ea7-a876-4932-a0ce-eb1a8965102b admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.576523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac6ea7-a876-4932-a0ce-eb1a8965102b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.576942 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac6ea7-a876-4932-a0ce-eb1a8965102b admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.577696 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac6ea7-a876-4932-a0ce-eb1a8965102b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:20.578001 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac6ea7-a876-4932-a0ce-eb1a8965102b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:20.579733 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac6ea7-a876-4932-a0ce-eb1a8965102b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:20.596104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1350/2722] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:20.597644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f7837-f745-4b29-9637-72ff49f63d3f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:20.608053 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f7837-f745-4b29-9637-72ff49f63d3f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:20.612653 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53174282-d2ef-42dc-bd7d-e8620986f0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:20.613296 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53174282-d2ef-42dc-bd7d-e8620986f0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.613580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53174282-d2ef-42dc-bd7d-e8620986f0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.613855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53174282-d2ef-42dc-bd7d-e8620986f0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.615126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53174282-d2ef-42dc-bd7d-e8620986f0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:20.617004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53174282-d2ef-42dc-bd7d-e8620986f0b4 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:20.642024 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1373/2723] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:20 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:43:20.646229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac6ea7-a876-4932-a0ce-eb1a8965102b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:20.656092 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac6ea7-a876-4932-a0ce-eb1a8965102b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:20.713872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff882a8-ff2a-4f70-8e69-5ef31d08937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:20.714596 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff882a8-ff2a-4f70-8e69-5ef31d08937f admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.714883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff882a8-ff2a-4f70-8e69-5ef31d08937f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.715163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff882a8-ff2a-4f70-8e69-5ef31d08937f admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.715909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff882a8-ff2a-4f70-8e69-5ef31d08937f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:20.717819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff882a8-ff2a-4f70-8e69-5ef31d08937f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:20.738457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1351/2724] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:20 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:20.742525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53174282-d2ef-42dc-bd7d-e8620986f0b4 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:20.753116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53174282-d2ef-42dc-bd7d-e8620986f0b4 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:20.757849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dc92f-b6da-4b11-9224-89764708ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:20.758541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dc92f-b6da-4b11-9224-89764708ef15 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.758828 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dc92f-b6da-4b11-9224-89764708ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.759108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dc92f-b6da-4b11-9224-89764708ef15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.759832 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dc92f-b6da-4b11-9224-89764708ef15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:20.761429 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dc92f-b6da-4b11-9224-89764708ef15 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:20.772177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1374/2725] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:20.775823 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff882a8-ff2a-4f70-8e69-5ef31d08937f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:20.780881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:20.786987 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff882a8-ff2a-4f70-8e69-5ef31d08937f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:20.792849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b896f9b-46e1-4492-9a26-707302c05acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:20.793556 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b896f9b-46e1-4492-9a26-707302c05acb admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.794016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b896f9b-46e1-4492-9a26-707302c05acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.794296 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b896f9b-46e1-4492-9a26-707302c05acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.795056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b896f9b-46e1-4492-9a26-707302c05acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:20.796680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b896f9b-46e1-4492-9a26-707302c05acb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:20.806823 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1352/2726] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:20.810887 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dc92f-b6da-4b11-9224-89764708ef15 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:20.820769 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dc92f-b6da-4b11-9224-89764708ef15 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:20.825375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2faaef-0bf4-4d01-baa5-30546fd0a80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:20.826243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2faaef-0bf4-4d01-baa5-30546fd0a80d admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.826556 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2faaef-0bf4-4d01-baa5-30546fd0a80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.826835 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2faaef-0bf4-4d01-baa5-30546fd0a80d admin admin] PATH_INFO: `/v3/projects/a12c2ee4ca2d496e850c6052e693cb02/users/cb0ad6084f424249a382abc6c03d4f05/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.841611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2faaef-0bf4-4d01-baa5-30546fd0a80d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12c2ee4ca2d496e850c6052e693cb02, user_id=cb0ad6084f424249a382abc6c03d4f05, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:20.844216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2faaef-0bf4-4d01-baa5-30546fd0a80d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:20.857067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1375/2727] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:20 2022] PUT /identity/v3/projects/a12c2ee4ca2d496e850c6052e693cb02/users/cb0ad6084f424249a382abc6c03d4f05/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:20.862186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813edec-8a12-4512-81fe-62babb6bd68e None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:20.862522 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813edec-8a12-4512-81fe-62babb6bd68e None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:20.862820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813edec-8a12-4512-81fe-62babb6bd68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:20.880266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6813edec-8a12-4512-81fe-62babb6bd68e None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:20.881463 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6813edec-8a12-4512-81fe-62babb6bd68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:20.938336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1353/2728] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:20.947808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2faaef-0bf4-4d01-baa5-30546fd0a80d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:20.949492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-de2faaef-0bf4-4d01-baa5-30546fd0a80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:21.009269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2faaef-0bf4-4d01-baa5-30546fd0a80d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:21.013321 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2d8c4-76b8-4988-aa34-4352cd9ab771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:21.013972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2d8c4-76b8-4988-aa34-4352cd9ab771 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:21.014264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2d8c4-76b8-4988-aa34-4352cd9ab771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:21.014639 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2d8c4-76b8-4988-aa34-4352cd9ab771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:21.024895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2d8c4-76b8-4988-aa34-4352cd9ab771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:21.026650 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2d8c4-76b8-4988-aa34-4352cd9ab771 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:21.037369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1376/2729] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:21.681685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c109-44f5-42fa-b0eb-ddcb01620767 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:21.682236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c109-44f5-42fa-b0eb-ddcb01620767 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:21.682236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c109-44f5-42fa-b0eb-ddcb01620767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:21.712481 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-5637c109-44f5-42fa-b0eb-ddcb01620767 None None] MFA Rules not processed for user `cb0ad6084f424249a382abc6c03d4f05`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:21.713976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5637c109-44f5-42fa-b0eb-ddcb01620767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:21.802736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1354/2730] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:21.807186 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2d8c4-76b8-4988-aa34-4352cd9ab771 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:21.820105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2d8c4-76b8-4988-aa34-4352cd9ab771 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:21.829377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3db43-df9d-4320-99d4-abdab26d6a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:21.830054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3db43-df9d-4320-99d4-abdab26d6a41 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:21.830340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3db43-df9d-4320-99d4-abdab26d6a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:21.831484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3db43-df9d-4320-99d4-abdab26d6a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:21.834005 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3db43-df9d-4320-99d4-abdab26d6a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:21.840159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3db43-df9d-4320-99d4-abdab26d6a41 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:21.877275 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1377/2731] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:21 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:21.878173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637c109-44f5-42fa-b0eb-ddcb01620767 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:21.891328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637c109-44f5-42fa-b0eb-ddcb01620767 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:21.953838 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830417f7-e93c-4a83-8357-ec88f8120428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:21.954540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830417f7-e93c-4a83-8357-ec88f8120428 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:21.954828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830417f7-e93c-4a83-8357-ec88f8120428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:21.955107 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830417f7-e93c-4a83-8357-ec88f8120428 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:21.955787 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830417f7-e93c-4a83-8357-ec88f8120428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:21.957698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830417f7-e93c-4a83-8357-ec88f8120428 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:21.977217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1355/2732] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:21 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:43:21.981099 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3db43-df9d-4320-99d4-abdab26d6a41 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:21.991580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3db43-df9d-4320-99d4-abdab26d6a41 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:21.996425 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b498f2-8aaf-4dfc-822e-0b13805d8107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:21.997080 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b498f2-8aaf-4dfc-822e-0b13805d8107 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:21.997374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b498f2-8aaf-4dfc-822e-0b13805d8107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:21.997651 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b498f2-8aaf-4dfc-822e-0b13805d8107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:21.998394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b498f2-8aaf-4dfc-822e-0b13805d8107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:21.999997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b498f2-8aaf-4dfc-822e-0b13805d8107 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:22.001245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:22.013915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1378/2733] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:43:22.017761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830417f7-e93c-4a83-8357-ec88f8120428 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:22.028277 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830417f7-e93c-4a83-8357-ec88f8120428 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:22.032931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21034be-eef1-4f78-beeb-f9b76ef38f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:22.033799 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21034be-eef1-4f78-beeb-f9b76ef38f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.034086 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21034be-eef1-4f78-beeb-f9b76ef38f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.034391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21034be-eef1-4f78-beeb-f9b76ef38f1f admin admin] PATH_INFO: `/v3/projects/9b0bc5bd1b9948658f2d19496caa6573/users/d65c167bcdb3455fb99cd331d7a0125b/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.042655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:22.049756 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21034be-eef1-4f78-beeb-f9b76ef38f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0bc5bd1b9948658f2d19496caa6573, user_id=d65c167bcdb3455fb99cd331d7a0125b, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:22.052614 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21034be-eef1-4f78-beeb-f9b76ef38f1f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:22.064978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1356/2734] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:22 2022] PUT /identity/v3/projects/9b0bc5bd1b9948658f2d19496caa6573/users/d65c167bcdb3455fb99cd331d7a0125b/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:22.069327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b498f2-8aaf-4dfc-822e-0b13805d8107 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:22.079494 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b498f2-8aaf-4dfc-822e-0b13805d8107 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:22.102930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21034be-eef1-4f78-beeb-f9b76ef38f1f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:22.104676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b21034be-eef1-4f78-beeb-f9b76ef38f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:22.141857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c6860-17be-4cfd-a127-b35f2f2a3978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:22.142585 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6860-17be-4cfd-a127-b35f2f2a3978 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.142979 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6860-17be-4cfd-a127-b35f2f2a3978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.143255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c6860-17be-4cfd-a127-b35f2f2a3978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.144006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c6860-17be-4cfd-a127-b35f2f2a3978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:22.146216 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c6860-17be-4cfd-a127-b35f2f2a3978 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:22.155881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1379/2735] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:22.159956 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c6860-17be-4cfd-a127-b35f2f2a3978 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:22.169521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c6860-17be-4cfd-a127-b35f2f2a3978 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:22.172299 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21034be-eef1-4f78-beeb-f9b76ef38f1f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:22.174047 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7901e87-d4d3-4ed3-9922-db58d428f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:22.174932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7901e87-d4d3-4ed3-9922-db58d428f51b admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.175212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7901e87-d4d3-4ed3-9922-db58d428f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.175486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7901e87-d4d3-4ed3-9922-db58d428f51b admin admin] PATH_INFO: `/v3/projects/9b0bc5bd1b9948658f2d19496caa6573/users/d65c167bcdb3455fb99cd331d7a0125b/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.177106 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:22.177389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7901e87-d4d3-4ed3-9922-db58d428f51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0bc5bd1b9948658f2d19496caa6573, user_id=d65c167bcdb3455fb99cd331d7a0125b, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:22.178043 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.178327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.178641 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] PATH_INFO: `/v3/users/6b89bdb2c1224697ad3dd5ea90aaf1a4` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.179844 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b89bdb2c1224697ad3dd5ea90aaf1a4)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:22.180132 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7901e87-d4d3-4ed3-9922-db58d428f51b admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:22.181868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:22.190767 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1380/2736] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:22 2022] PUT /identity/v3/projects/9b0bc5bd1b9948658f2d19496caa6573/users/d65c167bcdb3455fb99cd331d7a0125b/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:22.232920 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b89bdb2c1224697ad3dd5ea90aaf1a4'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:22.233539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b89bdb2c1224697ad3dd5ea90aaf1a4'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:22.234170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b89bdb2c1224697ad3dd5ea90aaf1a4'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:22.247243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b89bdb2c1224697ad3dd5ea90aaf1a4'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:22.254242 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b89bdb2c1224697ad3dd5ea90aaf1a4'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:22.269367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1357/2737] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:22 2022] DELETE /identity/v3/users/6b89bdb2c1224697ad3dd5ea90aaf1a4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:22.274385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5022a-ce3e-496e-8f86-c639a7187cf8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.274772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5022a-ce3e-496e-8f86-c639a7187cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.275126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5022a-ce3e-496e-8f86-c639a7187cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.296353 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-62e5022a-ce3e-496e-8f86-c639a7187cf8 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:22.297577 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-62e5022a-ce3e-496e-8f86-c639a7187cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:22.365477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1381/2738] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:22.392552 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:22.394207 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:22.460187 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcd00f-4ddb-48ad-8f00-4d3490b251a0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:22.463869 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f75eb-6e97-4596-bf64-e214fef229c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:22.464517 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f75eb-6e97-4596-bf64-e214fef229c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.464803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f75eb-6e97-4596-bf64-e214fef229c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.465080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f75eb-6e97-4596-bf64-e214fef229c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.478491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f75eb-6e97-4596-bf64-e214fef229c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:22.480365 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f75eb-6e97-4596-bf64-e214fef229c5 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:22.494890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1358/2739] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:22.814205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231f1b6-ce2a-4f9c-924f-8382930d0a22 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.814801 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231f1b6-ce2a-4f9c-924f-8382930d0a22 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.814915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231f1b6-ce2a-4f9c-924f-8382930d0a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.845206 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2231f1b6-ce2a-4f9c-924f-8382930d0a22 None None] MFA Rules not processed for user `d65c167bcdb3455fb99cd331d7a0125b`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:22.846504 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2231f1b6-ce2a-4f9c-924f-8382930d0a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:22.924386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1382/2740] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:22.937248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c8c92-e654-4a24-9b10-f8b6af26c9dc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:22.937248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c8c92-e654-4a24-9b10-f8b6af26c9dc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:22.937248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c8c92-e654-4a24-9b10-f8b6af26c9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:22.971848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-335c8c92-e654-4a24-9b10-f8b6af26c9dc None None] MFA Rules not processed for user `cb0ad6084f424249a382abc6c03d4f05`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:22.977160 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-335c8c92-e654-4a24-9b10-f8b6af26c9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:22.986778 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:23.085907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1359/2741] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:23.098549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231f1b6-ce2a-4f9c-924f-8382930d0a22 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:23.099958 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2231f1b6-ce2a-4f9c-924f-8382930d0a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:23.110276 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:23.114636 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c8c92-e654-4a24-9b10-f8b6af26c9dc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:23.116200 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-335c8c92-e654-4a24-9b10-f8b6af26c9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:23.138181 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c8c92-e654-4a24-9b10-f8b6af26c9dc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:23.144458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:23.146681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:23.147448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:23.147747 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] PATH_INFO: `/v3/projects/305e800eb68c48aa82a8ed3cd131cf33` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:23.149279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=305e800eb68c48aa82a8ed3cd131cf33)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:23.151547 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:23.198770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231f1b6-ce2a-4f9c-924f-8382930d0a22 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:23.204600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '305e800eb68c48aa82a8ed3cd131cf33', 'request_id': 'req-cb95c106-499b-457e-b467-342d9ea6bf2f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:23.210314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '305e800eb68c48aa82a8ed3cd131cf33', 'request_id': 'req-cb95c106-499b-457e-b467-342d9ea6bf2f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:23.217313 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '305e800eb68c48aa82a8ed3cd131cf33', 'request_id': 'req-cb95c106-499b-457e-b467-342d9ea6bf2f'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:23.231191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] The token cache is being invalidate because project 305e800eb68c48aa82a8ed3cd131cf33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:23.231512 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:23.232116 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:23.233941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1360/2742] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:23 2022] DELETE /identity/v3/projects/305e800eb68c48aa82a8ed3cd131cf33 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:23.278114 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feae2f-2c1a-49c9-babe-59896b43e34b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66ff3915a784ddcb3925aadcb416700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:23.279034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feae2f-2c1a-49c9-babe-59896b43e34b service nova] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:23.279389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feae2f-2c1a-49c9-babe-59896b43e34b service nova] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:23.279891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feae2f-2c1a-49c9-babe-59896b43e34b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:23.281994 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-96feae2f-2c1a-49c9-babe-59896b43e34b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:23.360118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feae2f-2c1a-49c9-babe-59896b43e34b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:23.361755 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feae2f-2c1a-49c9-babe-59896b43e34b service nova] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:23.373134 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1383/2743] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:25.455327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:25.457048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:25.514917 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c106-499b-457e-b467-342d9ea6bf2f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:25.518488 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6b294-4617-4a92-b039-4522e11d2ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:25.519129 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b294-4617-4a92-b039-4522e11d2ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:25.519414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b294-4617-4a92-b039-4522e11d2ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:25.519694 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b294-4617-4a92-b039-4522e11d2ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:25.523894 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-bca6b294-4617-4a92-b039-4522e11d2ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:25.533657 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6b294-4617-4a92-b039-4522e11d2ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:25.535111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6b294-4617-4a92-b039-4522e11d2ad8 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:25.543703 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1361/2744] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:33.368805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=82 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:34.110795 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feae2f-2c1a-49c9-babe-59896b43e34b service nova] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:34.112204 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-96feae2f-2c1a-49c9-babe-59896b43e34b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:34.176959 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feae2f-2c1a-49c9-babe-59896b43e34b service nova] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:34.181978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:34.182878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:34.183167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:34.183473 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] PATH_INFO: `/v3/users/cd89e14205ab43ed8142e8977f1a5260` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:34.184657 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd89e14205ab43ed8142e8977f1a5260)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:34.186606 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:34.233470 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd89e14205ab43ed8142e8977f1a5260'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.234118 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd89e14205ab43ed8142e8977f1a5260'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.242550 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd89e14205ab43ed8142e8977f1a5260'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.255187 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd89e14205ab43ed8142e8977f1a5260'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.262199 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd89e14205ab43ed8142e8977f1a5260'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.268460 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1384/2745] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:34 2022] DELETE /identity/v3/users/cd89e14205ab43ed8142e8977f1a5260 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:34.272744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3a93-8f4e-4e50-81b7-d82aa2250f06 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:34.273118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3a93-8f4e-4e50-81b7-d82aa2250f06 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:34.273337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3a93-8f4e-4e50-81b7-d82aa2250f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:34.291245 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-f51e3a93-8f4e-4e50-81b7-d82aa2250f06 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:34.292449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f51e3a93-8f4e-4e50-81b7-d82aa2250f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:34.327713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:34.356182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1362/2746] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:34.366347 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:34.367781 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:34.427667 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdc191-9c34-4bcc-84fe-c2b89468d72c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:34.432059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4388519-36ad-4536-9f96-1524fc29a0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:34.432710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4388519-36ad-4536-9f96-1524fc29a0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:34.432997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4388519-36ad-4536-9f96-1524fc29a0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:34.433306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4388519-36ad-4536-9f96-1524fc29a0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:34.442366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4388519-36ad-4536-9f96-1524fc29a0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:34.443834 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4388519-36ad-4536-9f96-1524fc29a0c6 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:34.454675 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1385/2747] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:34.723150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3a93-8f4e-4e50-81b7-d82aa2250f06 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:34.725274 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-f51e3a93-8f4e-4e50-81b7-d82aa2250f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:34.740362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3a93-8f4e-4e50-81b7-d82aa2250f06 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:34.745302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65539170-9814-4384-a21e-768466c40946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:34.746162 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65539170-9814-4384-a21e-768466c40946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:34.746470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65539170-9814-4384-a21e-768466c40946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:34.746749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65539170-9814-4384-a21e-768466c40946 admin admin] PATH_INFO: `/v3/projects/29cd9797e56e4f6ea71eff73a2a12438` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:34.747934 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65539170-9814-4384-a21e-768466c40946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cd9797e56e4f6ea71eff73a2a12438)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:34.749872 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65539170-9814-4384-a21e-768466c40946 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:34.795744 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65539170-9814-4384-a21e-768466c40946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cd9797e56e4f6ea71eff73a2a12438', 'request_id': 'req-65539170-9814-4384-a21e-768466c40946'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.802339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65539170-9814-4384-a21e-768466c40946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cd9797e56e4f6ea71eff73a2a12438', 'request_id': 'req-65539170-9814-4384-a21e-768466c40946'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.808612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65539170-9814-4384-a21e-768466c40946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cd9797e56e4f6ea71eff73a2a12438', 'request_id': 'req-65539170-9814-4384-a21e-768466c40946'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.820850 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65539170-9814-4384-a21e-768466c40946 admin admin] The token cache is being invalidate because project 29cd9797e56e4f6ea71eff73a2a12438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:34.821140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65539170-9814-4384-a21e-768466c40946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.821757 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-65539170-9814-4384-a21e-768466c40946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.823342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1363/2748] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:34 2022] DELETE /identity/v3/projects/29cd9797e56e4f6ea71eff73a2a12438 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:34.827314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4388519-36ad-4536-9f96-1524fc29a0c6 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:34.837388 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4388519-36ad-4536-9f96-1524fc29a0c6 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:34.855812 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:34.895314 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:34.896245 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:34.897062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:34.897349 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] PATH_INFO: `/v3/users/17659eb96adb4210a9305b46d9620cf9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:34.898659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=17659eb96adb4210a9305b46d9620cf9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:34.900560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:34.947038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17659eb96adb4210a9305b46d9620cf9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.947680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17659eb96adb4210a9305b46d9620cf9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.954718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17659eb96adb4210a9305b46d9620cf9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.967256 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17659eb96adb4210a9305b46d9620cf9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.973864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-1caf5d7f-7fcd-477a-8fcb-bd2df935b6ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17659eb96adb4210a9305b46d9620cf9'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:34.980220 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1386/2749] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:34 2022] DELETE /identity/v3/users/17659eb96adb4210a9305b46d9620cf9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:35.254903 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65539170-9814-4384-a21e-768466c40946 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.256877 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-65539170-9814-4384-a21e-768466c40946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:35.270433 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65539170-9814-4384-a21e-768466c40946 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.327820 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.328676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.328959 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.329234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] PATH_INFO: `/v3/projects/3f2a265abc7f41e5b1c204f6fe874ee1` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.330418 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2a265abc7f41e5b1c204f6fe874ee1)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.332301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.378913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2a265abc7f41e5b1c204f6fe874ee1', 'request_id': 'req-ef459515-d874-4248-ad8a-7d7232cdcd61'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:35.384378 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2a265abc7f41e5b1c204f6fe874ee1', 'request_id': 'req-ef459515-d874-4248-ad8a-7d7232cdcd61'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:35.391681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2a265abc7f41e5b1c204f6fe874ee1', 'request_id': 'req-ef459515-d874-4248-ad8a-7d7232cdcd61'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:35.394243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:35.406856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] The token cache is being invalidate because project 3f2a265abc7f41e5b1c204f6fe874ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:35.407145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:35.407763 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-ef459515-d874-4248-ad8a-7d7232cdcd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:35.409317 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1364/2750] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:35 2022] DELETE /identity/v3/projects/3f2a265abc7f41e5b1c204f6fe874ee1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:35.414884 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3d274-5057-4c90-acbd-c55c4b63f2ab None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.415175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3d274-5057-4c90-acbd-c55c4b63f2ab None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.415456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3d274-5057-4c90-acbd-c55c4b63f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.434250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-c9b3d274-5057-4c90-acbd-c55c4b63f2ab None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:35.435559 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-c9b3d274-5057-4c90-acbd-c55c4b63f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:35.501449 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1387/2751] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:35.510963 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a429d6-3d2d-4ef9-95cc-f5f58e74cf39 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.511258 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a429d6-3d2d-4ef9-95cc-f5f58e74cf39 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.511538 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a429d6-3d2d-4ef9-95cc-f5f58e74cf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.530097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a4a429d6-3d2d-4ef9-95cc-f5f58e74cf39 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:35.531349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a4a429d6-3d2d-4ef9-95cc-f5f58e74cf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:35.539441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1365/2752] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:35.543616 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3d274-5057-4c90-acbd-c55c4b63f2ab None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.553871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3d274-5057-4c90-acbd-c55c4b63f2ab None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.558399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46ab7d-349c-4505-8ea5-3f8dffb12ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.559055 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46ab7d-349c-4505-8ea5-3f8dffb12ace admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.559339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46ab7d-349c-4505-8ea5-3f8dffb12ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.559610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46ab7d-349c-4505-8ea5-3f8dffb12ace admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.560328 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46ab7d-349c-4505-8ea5-3f8dffb12ace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:35.560633 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46ab7d-349c-4505-8ea5-3f8dffb12ace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.562394 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46ab7d-349c-4505-8ea5-3f8dffb12ace admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.582862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1388/2753] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:35.587126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a429d6-3d2d-4ef9-95cc-f5f58e74cf39 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.597048 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a429d6-3d2d-4ef9-95cc-f5f58e74cf39 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.601901 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b0fd0-2d43-4d41-a19b-0d720f03583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.602585 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b0fd0-2d43-4d41-a19b-0d720f03583a admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.602870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b0fd0-2d43-4d41-a19b-0d720f03583a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.603145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b0fd0-2d43-4d41-a19b-0d720f03583a admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.603864 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b0fd0-2d43-4d41-a19b-0d720f03583a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.605829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b0fd0-2d43-4d41-a19b-0d720f03583a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.632206 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1366/2754] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:35 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:35.636655 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46ab7d-349c-4505-8ea5-3f8dffb12ace admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.654016 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46ab7d-349c-4505-8ea5-3f8dffb12ace admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.682390 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:35.717411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda796b7-3e85-4df0-ab68-da066f5a35cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.718092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda796b7-3e85-4df0-ab68-da066f5a35cf admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.718401 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda796b7-3e85-4df0-ab68-da066f5a35cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.718685 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda796b7-3e85-4df0-ab68-da066f5a35cf admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.719376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda796b7-3e85-4df0-ab68-da066f5a35cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.721325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda796b7-3e85-4df0-ab68-da066f5a35cf admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.742052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1389/2755] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:35 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:35.746196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b0fd0-2d43-4d41-a19b-0d720f03583a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.756745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b0fd0-2d43-4d41-a19b-0d720f03583a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.761447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980d31e-37d9-4e0b-ae3b-278770c6282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.762097 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980d31e-37d9-4e0b-ae3b-278770c6282e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.762413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980d31e-37d9-4e0b-ae3b-278770c6282e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.762695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980d31e-37d9-4e0b-ae3b-278770c6282e admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.763413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980d31e-37d9-4e0b-ae3b-278770c6282e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.765003 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980d31e-37d9-4e0b-ae3b-278770c6282e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.777382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1367/2756] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:35.781301 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda796b7-3e85-4df0-ab68-da066f5a35cf admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.791819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda796b7-3e85-4df0-ab68-da066f5a35cf admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.796456 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc150b-5f96-44df-a4b8-4895732bfea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.797117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc150b-5f96-44df-a4b8-4895732bfea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.797406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc150b-5f96-44df-a4b8-4895732bfea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.797682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc150b-5f96-44df-a4b8-4895732bfea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.798441 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc150b-5f96-44df-a4b8-4895732bfea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.800098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc150b-5f96-44df-a4b8-4895732bfea5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.810710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1390/2757] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:35.814655 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980d31e-37d9-4e0b-ae3b-278770c6282e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:35.824568 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980d31e-37d9-4e0b-ae3b-278770c6282e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:35.829414 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f7c5-18e5-4069-b779-173e2ed94653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:35.830320 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f7c5-18e5-4069-b779-173e2ed94653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.830642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f7c5-18e5-4069-b779-173e2ed94653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.830951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f7c5-18e5-4069-b779-173e2ed94653 admin admin] PATH_INFO: `/v3/projects/de8d1eeac4024c158d30391654984c60/users/d256ba560a1c48888b454dc594d6076d/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.846505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815f7c5-18e5-4069-b779-173e2ed94653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8d1eeac4024c158d30391654984c60, user_id=d256ba560a1c48888b454dc594d6076d, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:35.849335 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815f7c5-18e5-4069-b779-173e2ed94653 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:35.863379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1368/2758] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:35 2022] PUT /identity/v3/projects/de8d1eeac4024c158d30391654984c60/users/d256ba560a1c48888b454dc594d6076d/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:35.874213 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea2b4f-fff6-4664-85ca-a5f0c9227fae None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:35.874542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea2b4f-fff6-4664-85ca-a5f0c9227fae None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:35.874821 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea2b4f-fff6-4664-85ca-a5f0c9227fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:35.900609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-edea2b4f-fff6-4664-85ca-a5f0c9227fae None None] MFA Rules not processed for user `d256ba560a1c48888b454dc594d6076d`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:35.901851 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-edea2b4f-fff6-4664-85ca-a5f0c9227fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:35.964544 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1391/2759] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:35.968883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f7c5-18e5-4069-b779-173e2ed94653 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.027930 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f7c5-18e5-4069-b779-173e2ed94653 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.032516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e85fe-4f62-46a1-985a-09d85d61fd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.033159 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e85fe-4f62-46a1-985a-09d85d61fd5b admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.033458 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e85fe-4f62-46a1-985a-09d85d61fd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.033713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e85fe-4f62-46a1-985a-09d85d61fd5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.034407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e85fe-4f62-46a1-985a-09d85d61fd5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.036268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e85fe-4f62-46a1-985a-09d85d61fd5b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.061288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1369/2760] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:35 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:36.065258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea2b4f-fff6-4664-85ca-a5f0c9227fae None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.076478 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea2b4f-fff6-4664-85ca-a5f0c9227fae None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.132841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1d415-af39-4b13-9a3b-0ded8a674663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.133520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1d415-af39-4b13-9a3b-0ded8a674663 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.133810 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1d415-af39-4b13-9a3b-0ded8a674663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.134098 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1d415-af39-4b13-9a3b-0ded8a674663 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.134842 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1d415-af39-4b13-9a3b-0ded8a674663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.136730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1d415-af39-4b13-9a3b-0ded8a674663 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.155514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1392/2761] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:36 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:43:36.159580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e85fe-4f62-46a1-985a-09d85d61fd5b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.169797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e85fe-4f62-46a1-985a-09d85d61fd5b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.175019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba5b2-5671-4848-9701-4cfffa514455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.175698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba5b2-5671-4848-9701-4cfffa514455 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.175979 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba5b2-5671-4848-9701-4cfffa514455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.176253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba5b2-5671-4848-9701-4cfffa514455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.176977 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fba5b2-5671-4848-9701-4cfffa514455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.179087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fba5b2-5671-4848-9701-4cfffa514455 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.189537 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1370/2762] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:36.194509 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1d415-af39-4b13-9a3b-0ded8a674663 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.204663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1d415-af39-4b13-9a3b-0ded8a674663 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.209687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965d0fe-5875-47b6-b94d-8eaedb5abf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.210591 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965d0fe-5875-47b6-b94d-8eaedb5abf3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.210871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965d0fe-5875-47b6-b94d-8eaedb5abf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.211146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965d0fe-5875-47b6-b94d-8eaedb5abf3c admin admin] PATH_INFO: `/v3/projects/12d6891bc1874fce9806004ae8f4c4d3/users/9ff02b22bfb841aba21ab2510ec1f9f7/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.226093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965d0fe-5875-47b6-b94d-8eaedb5abf3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d6891bc1874fce9806004ae8f4c4d3, user_id=9ff02b22bfb841aba21ab2510ec1f9f7, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.228750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965d0fe-5875-47b6-b94d-8eaedb5abf3c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.241288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1393/2763] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:36 2022] PUT /identity/v3/projects/12d6891bc1874fce9806004ae8f4c4d3/users/9ff02b22bfb841aba21ab2510ec1f9f7/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:36.245581 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba5b2-5671-4848-9701-4cfffa514455 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.255740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba5b2-5671-4848-9701-4cfffa514455 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.310438 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e3abe-1a54-4099-9206-aa009be26cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.311060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3abe-1a54-4099-9206-aa009be26cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.311349 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3abe-1a54-4099-9206-aa009be26cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.311630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3abe-1a54-4099-9206-aa009be26cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.312386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e3abe-1a54-4099-9206-aa009be26cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.314020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e3abe-1a54-4099-9206-aa009be26cfb admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.319177 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:36.324834 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1371/2764] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:36.328536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965d0fe-5875-47b6-b94d-8eaedb5abf3c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.334560 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:36.340686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965d0fe-5875-47b6-b94d-8eaedb5abf3c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.345341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a515f9-137d-404b-80a8-cbf85b701c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.346215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a515f9-137d-404b-80a8-cbf85b701c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.346546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a515f9-137d-404b-80a8-cbf85b701c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.346826 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a515f9-137d-404b-80a8-cbf85b701c37 admin admin] PATH_INFO: `/v3/projects/12d6891bc1874fce9806004ae8f4c4d3/users/9ff02b22bfb841aba21ab2510ec1f9f7/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.348788 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a515f9-137d-404b-80a8-cbf85b701c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d6891bc1874fce9806004ae8f4c4d3, user_id=9ff02b22bfb841aba21ab2510ec1f9f7, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.352066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a515f9-137d-404b-80a8-cbf85b701c37 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.362317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1394/2765] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:36 2022] PUT /identity/v3/projects/12d6891bc1874fce9806004ae8f4c4d3/users/9ff02b22bfb841aba21ab2510ec1f9f7/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:36.373501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61763f8-0d2b-45ab-9827-5384acafb69b None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.374012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61763f8-0d2b-45ab-9827-5384acafb69b None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.374113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61763f8-0d2b-45ab-9827-5384acafb69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.400298 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-e61763f8-0d2b-45ab-9827-5384acafb69b None None] MFA Rules not processed for user `9ff02b22bfb841aba21ab2510ec1f9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:36.401508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-e61763f8-0d2b-45ab-9827-5384acafb69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:36.470895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1372/2766] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:36.482308 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a515f9-137d-404b-80a8-cbf85b701c37 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.484066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-44a515f9-137d-404b-80a8-cbf85b701c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:36.539981 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a515f9-137d-404b-80a8-cbf85b701c37 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.543649 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c501c8b-38a9-4f57-8e18-4e38f0bf036e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.544285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501c8b-38a9-4f57-8e18-4e38f0bf036e service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.544567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501c8b-38a9-4f57-8e18-4e38f0bf036e service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.544849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501c8b-38a9-4f57-8e18-4e38f0bf036e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.554331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c501c8b-38a9-4f57-8e18-4e38f0bf036e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.556014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c501c8b-38a9-4f57-8e18-4e38f0bf036e service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.569042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1395/2767] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:36.641169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61763f8-0d2b-45ab-9827-5384acafb69b None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:36.651661 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61763f8-0d2b-45ab-9827-5384acafb69b None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:36.655305 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23a30-5582-4fff-86a0-9dd5574a992b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:36.655947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23a30-5582-4fff-86a0-9dd5574a992b service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:36.656239 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23a30-5582-4fff-86a0-9dd5574a992b service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:36.656520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23a30-5582-4fff-86a0-9dd5574a992b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:36.716493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23a30-5582-4fff-86a0-9dd5574a992b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:36.718030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23a30-5582-4fff-86a0-9dd5574a992b service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:36.727493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1373/2768] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:38.543516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c501c8b-38a9-4f57-8e18-4e38f0bf036e service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:38.551980 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c501c8b-38a9-4f57-8e18-4e38f0bf036e service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:38.556322 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e991d0-a915-40f7-a8e0-e595759eb7a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:38.556951 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e991d0-a915-40f7-a8e0-e595759eb7a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:38.557228 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e991d0-a915-40f7-a8e0-e595759eb7a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:38.557506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e991d0-a915-40f7-a8e0-e595759eb7a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:38.559306 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d0e991d0-a915-40f7-a8e0-e595759eb7a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:38.621999 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e991d0-a915-40f7-a8e0-e595759eb7a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:38.623463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e991d0-a915-40f7-a8e0-e595759eb7a7 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:38.634000 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1396/2769] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:43.658436 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23a30-5582-4fff-86a0-9dd5574a992b service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:43.718836 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23a30-5582-4fff-86a0-9dd5574a992b service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:43.723952 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:43.725449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:43.725880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:43.726167 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] PATH_INFO: `/v3/users/d256ba560a1c48888b454dc594d6076d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:43.727439 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d256ba560a1c48888b454dc594d6076d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:43.729336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:43.757392 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:43.776134 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd256ba560a1c48888b454dc594d6076d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:43.776777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd256ba560a1c48888b454dc594d6076d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:43.777387 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd256ba560a1c48888b454dc594d6076d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:43.789922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd256ba560a1c48888b454dc594d6076d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:43.796739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd256ba560a1c48888b454dc594d6076d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:43.809342 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1374/2770] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:43 2022] DELETE /identity/v3/users/d256ba560a1c48888b454dc594d6076d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:43.814090 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baddd3-35e7-4608-94f8-8cd623cbef0f None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:43.814621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baddd3-35e7-4608-94f8-8cd623cbef0f None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:43.814723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baddd3-35e7-4608-94f8-8cd623cbef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:43.831160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a7baddd3-35e7-4608-94f8-8cd623cbef0f None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:43.832340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a7baddd3-35e7-4608-94f8-8cd623cbef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:43.891062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1397/2771] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:43.901403 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:43.902833 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:43.961577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffd530-4f4e-4303-bdd2-ddeea7deb8c1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:43.965266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62e60a-9c3e-4cce-857e-cbce093bd345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:43.965913 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62e60a-9c3e-4cce-857e-cbce093bd345 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:43.966198 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62e60a-9c3e-4cce-857e-cbce093bd345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:43.966612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62e60a-9c3e-4cce-857e-cbce093bd345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:43.976506 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62e60a-9c3e-4cce-857e-cbce093bd345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:43.977923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62e60a-9c3e-4cce-857e-cbce093bd345 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:43.987536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1375/2772] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:44.275012 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baddd3-35e7-4608-94f8-8cd623cbef0f None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:44.276513 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a7baddd3-35e7-4608-94f8-8cd623cbef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:44.289297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baddd3-35e7-4608-94f8-8cd623cbef0f None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:44.293976 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:44.294900 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:44.295194 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:44.295475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] PATH_INFO: `/v3/projects/de8d1eeac4024c158d30391654984c60` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:44.297731 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8d1eeac4024c158d30391654984c60)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:44.299694 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:44.324752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:44.350638 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8d1eeac4024c158d30391654984c60', 'request_id': 'req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.357730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8d1eeac4024c158d30391654984c60', 'request_id': 'req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.363436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8d1eeac4024c158d30391654984c60', 'request_id': 'req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.375351 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] The token cache is being invalidate because project de8d1eeac4024c158d30391654984c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:44.375641 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.376269 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.377803 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1398/2773] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:44 2022] DELETE /identity/v3/projects/de8d1eeac4024c158d30391654984c60 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:44.382376 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62e60a-9c3e-4cce-857e-cbce093bd345 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:44.391907 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62e60a-9c3e-4cce-857e-cbce093bd345 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:44.447325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:44.448182 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:44.448465 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:44.448743 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] PATH_INFO: `/v3/users/9ff02b22bfb841aba21ab2510ec1f9f7` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:44.449910 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff02b22bfb841aba21ab2510ec1f9f7)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:44.452078 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:44.499091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff02b22bfb841aba21ab2510ec1f9f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.499745 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff02b22bfb841aba21ab2510ec1f9f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.500359 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff02b22bfb841aba21ab2510ec1f9f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.501485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:44.515994 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff02b22bfb841aba21ab2510ec1f9f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.522797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5228a399-6a79-4b51-bd1f-e74205f88ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff02b22bfb841aba21ab2510ec1f9f7'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.535060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1376/2774] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:44 2022] DELETE /identity/v3/users/9ff02b22bfb841aba21ab2510ec1f9f7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:44.802453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:44.804523 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:44.821516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3203-86f3-4bc1-a9ca-e7a8044ca7d0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:44.883214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:44.884066 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:44.884346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:44.884620 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] PATH_INFO: `/v3/projects/12d6891bc1874fce9806004ae8f4c4d3` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:44.885783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d6891bc1874fce9806004ae8f4c4d3)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:44.887705 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:44.934760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d6891bc1874fce9806004ae8f4c4d3', 'request_id': 'req-290b0527-642b-4643-ac2c-b57a8b35aab7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.941630 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d6891bc1874fce9806004ae8f4c4d3', 'request_id': 'req-290b0527-642b-4643-ac2c-b57a8b35aab7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.947137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d6891bc1874fce9806004ae8f4c4d3', 'request_id': 'req-290b0527-642b-4643-ac2c-b57a8b35aab7'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.958021 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] The token cache is being invalidate because project 12d6891bc1874fce9806004ae8f4c4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:44.958312 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.958983 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-290b0527-642b-4643-ac2c-b57a8b35aab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:44.960511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1399/2775] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:44 2022] DELETE /identity/v3/projects/12d6891bc1874fce9806004ae8f4c4d3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:44.965680 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541dc2d-bc47-489a-accf-72978b0b5251 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:44.966171 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541dc2d-bc47-489a-accf-72978b0b5251 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:44.966267 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541dc2d-bc47-489a-accf-72978b0b5251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:44.985812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-6541dc2d-bc47-489a-accf-72978b0b5251 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:44.987039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-6541dc2d-bc47-489a-accf-72978b0b5251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:45.046479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1377/2776] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:45.054856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4a53-fbd1-4af7-bc21-42f6dd7cb3bc None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.055144 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4a53-fbd1-4af7-bc21-42f6dd7cb3bc None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.055419 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4a53-fbd1-4af7-bc21-42f6dd7cb3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.072931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f6ab4a53-fbd1-4af7-bc21-42f6dd7cb3bc None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:45.074122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f6ab4a53-fbd1-4af7-bc21-42f6dd7cb3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:45.081864 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1400/2777] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:45.086402 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541dc2d-bc47-489a-accf-72978b0b5251 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.096002 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541dc2d-bc47-489a-accf-72978b0b5251 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.101154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc6568-adfc-4d02-87fa-e034a3fe4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.101866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc6568-adfc-4d02-87fa-e034a3fe4eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.102145 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc6568-adfc-4d02-87fa-e034a3fe4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.102460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc6568-adfc-4d02-87fa-e034a3fe4eb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.103179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc6568-adfc-4d02-87fa-e034a3fe4eb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:45.103540 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc6568-adfc-4d02-87fa-e034a3fe4eb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.105120 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc6568-adfc-4d02-87fa-e034a3fe4eb1 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.117229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1378/2778] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:45.121672 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab4a53-fbd1-4af7-bc21-42f6dd7cb3bc None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.131246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab4a53-fbd1-4af7-bc21-42f6dd7cb3bc None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.135845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeabfb3-aaf4-43f6-8d6b-5d9006b959d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.136489 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeabfb3-aaf4-43f6-8d6b-5d9006b959d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.136774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeabfb3-aaf4-43f6-8d6b-5d9006b959d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.137051 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeabfb3-aaf4-43f6-8d6b-5d9006b959d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.137740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeabfb3-aaf4-43f6-8d6b-5d9006b959d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.139698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeabfb3-aaf4-43f6-8d6b-5d9006b959d1 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.167386 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1401/2779] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:45 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:45.171691 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc6568-adfc-4d02-87fa-e034a3fe4eb1 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.182285 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc6568-adfc-4d02-87fa-e034a3fe4eb1 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.238531 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ffd7-ec9e-4bd7-a6ce-dff2f1818f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.239266 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ffd7-ec9e-4bd7-a6ce-dff2f1818f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.239615 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ffd7-ec9e-4bd7-a6ce-dff2f1818f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.239898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ffd7-ec9e-4bd7-a6ce-dff2f1818f87 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.240583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76ffd7-ec9e-4bd7-a6ce-dff2f1818f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.242501 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76ffd7-ec9e-4bd7-a6ce-dff2f1818f87 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.263470 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1379/2780] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:45 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:45.267426 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeabfb3-aaf4-43f6-8d6b-5d9006b959d1 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.278666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeabfb3-aaf4-43f6-8d6b-5d9006b959d1 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.283579 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7501-b044-407b-b78d-45d9ab6d444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.284248 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7501-b044-407b-b78d-45d9ab6d444d admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.284530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7501-b044-407b-b78d-45d9ab6d444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.284809 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7501-b044-407b-b78d-45d9ab6d444d admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.285565 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7501-b044-407b-b78d-45d9ab6d444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.287866 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7501-b044-407b-b78d-45d9ab6d444d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.293222 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:45.300348 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1402/2781] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:45.304101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ffd7-ec9e-4bd7-a6ce-dff2f1818f87 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.314060 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ffd7-ec9e-4bd7-a6ce-dff2f1818f87 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.319416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2aff65-e076-4c85-b5bf-a73fe00e8070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.320069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aff65-e076-4c85-b5bf-a73fe00e8070 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.320415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aff65-e076-4c85-b5bf-a73fe00e8070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.320777 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2aff65-e076-4c85-b5bf-a73fe00e8070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.321420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2aff65-e076-4c85-b5bf-a73fe00e8070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.323089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2aff65-e076-4c85-b5bf-a73fe00e8070 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.333323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1380/2782] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:45.337964 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7501-b044-407b-b78d-45d9ab6d444d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.347932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7501-b044-407b-b78d-45d9ab6d444d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.353084 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd0b7b-803b-46b0-8a26-02539249ccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.353954 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd0b7b-803b-46b0-8a26-02539249ccae admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.354239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd0b7b-803b-46b0-8a26-02539249ccae admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.354538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd0b7b-803b-46b0-8a26-02539249ccae admin admin] PATH_INFO: `/v3/projects/97ba7e122fe14f949c3732c267e9c042/users/493ee4528dec49ecbd3a6c63946a9a6e/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.370059 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd0b7b-803b-46b0-8a26-02539249ccae admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ba7e122fe14f949c3732c267e9c042, user_id=493ee4528dec49ecbd3a6c63946a9a6e, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.372750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd0b7b-803b-46b0-8a26-02539249ccae admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.386122 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1403/2783] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:45 2022] PUT /identity/v3/projects/97ba7e122fe14f949c3732c267e9c042/users/493ee4528dec49ecbd3a6c63946a9a6e/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:45.397170 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1885f4-af40-4f52-8a9d-c40e1780dece None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.397457 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1885f4-af40-4f52-8a9d-c40e1780dece None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.397740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1885f4-af40-4f52-8a9d-c40e1780dece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.428735 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-de1885f4-af40-4f52-8a9d-c40e1780dece None None] MFA Rules not processed for user `493ee4528dec49ecbd3a6c63946a9a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:45.430118 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-de1885f4-af40-4f52-8a9d-c40e1780dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:45.449990 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:45.509988 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1381/2784] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:45.514376 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd0b7b-803b-46b0-8a26-02539249ccae admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.579110 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd0b7b-803b-46b0-8a26-02539249ccae admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.584535 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053eb51-e388-4e7c-a1c9-0130f274f53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.585190 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053eb51-e388-4e7c-a1c9-0130f274f53f admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.585474 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053eb51-e388-4e7c-a1c9-0130f274f53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.585752 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053eb51-e388-4e7c-a1c9-0130f274f53f admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.586493 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053eb51-e388-4e7c-a1c9-0130f274f53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.588397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053eb51-e388-4e7c-a1c9-0130f274f53f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.612758 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1404/2785] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:45 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:45.617089 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1885f4-af40-4f52-8a9d-c40e1780dece None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.627889 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1885f4-af40-4f52-8a9d-c40e1780dece None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.684227 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f17947-b86b-466d-978a-4fbac6b3fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.684931 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f17947-b86b-466d-978a-4fbac6b3fa29 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.685219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f17947-b86b-466d-978a-4fbac6b3fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.685495 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f17947-b86b-466d-978a-4fbac6b3fa29 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.686217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f17947-b86b-466d-978a-4fbac6b3fa29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.688760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f17947-b86b-466d-978a-4fbac6b3fa29 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.710951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1382/2786] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:45 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:45.715105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053eb51-e388-4e7c-a1c9-0130f274f53f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.726111 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053eb51-e388-4e7c-a1c9-0130f274f53f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.730882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c012df-d125-4cd6-954b-b9f19fd64d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.731543 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c012df-d125-4cd6-954b-b9f19fd64d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.731829 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c012df-d125-4cd6-954b-b9f19fd64d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.732108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c012df-d125-4cd6-954b-b9f19fd64d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.732843 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c012df-d125-4cd6-954b-b9f19fd64d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.734476 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c012df-d125-4cd6-954b-b9f19fd64d42 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.745941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1405/2787] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:45.749918 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f17947-b86b-466d-978a-4fbac6b3fa29 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.759873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f17947-b86b-466d-978a-4fbac6b3fa29 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.764523 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e0c18-ddbc-4e8e-85cd-7dadbd4debf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.765391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e0c18-ddbc-4e8e-85cd-7dadbd4debf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.765677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e0c18-ddbc-4e8e-85cd-7dadbd4debf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.765957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e0c18-ddbc-4e8e-85cd-7dadbd4debf9 admin admin] PATH_INFO: `/v3/projects/ca8050fbc66844f5bad27e98049b8d0d/users/3256bb8ed9074167946501b47edee707/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.780423 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e0c18-ddbc-4e8e-85cd-7dadbd4debf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8050fbc66844f5bad27e98049b8d0d, user_id=3256bb8ed9074167946501b47edee707, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.783107 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e0c18-ddbc-4e8e-85cd-7dadbd4debf9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.798604 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1383/2788] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:45 2022] PUT /identity/v3/projects/ca8050fbc66844f5bad27e98049b8d0d/users/3256bb8ed9074167946501b47edee707/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:45.803257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c012df-d125-4cd6-954b-b9f19fd64d42 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.813318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c012df-d125-4cd6-954b-b9f19fd64d42 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.869461 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e70fd2-d295-4579-a002-45a708fbbcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.870174 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e70fd2-d295-4579-a002-45a708fbbcbc admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.870496 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e70fd2-d295-4579-a002-45a708fbbcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.870777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e70fd2-d295-4579-a002-45a708fbbcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.871506 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e70fd2-d295-4579-a002-45a708fbbcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.873146 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e70fd2-d295-4579-a002-45a708fbbcbc admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.882941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1406/2789] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:45.887079 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e0c18-ddbc-4e8e-85cd-7dadbd4debf9 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:45.897969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e0c18-ddbc-4e8e-85cd-7dadbd4debf9 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:45.902628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e522eb6-a55b-4b79-aff6-ebec6452850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:45.903504 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e522eb6-a55b-4b79-aff6-ebec6452850e admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.903792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e522eb6-a55b-4b79-aff6-ebec6452850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.904069 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e522eb6-a55b-4b79-aff6-ebec6452850e admin admin] PATH_INFO: `/v3/projects/ca8050fbc66844f5bad27e98049b8d0d/users/3256bb8ed9074167946501b47edee707/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.906049 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e522eb6-a55b-4b79-aff6-ebec6452850e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8050fbc66844f5bad27e98049b8d0d, user_id=3256bb8ed9074167946501b47edee707, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:45.908713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e522eb6-a55b-4b79-aff6-ebec6452850e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:45.919453 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1384/2790] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:45 2022] PUT /identity/v3/projects/ca8050fbc66844f5bad27e98049b8d0d/users/3256bb8ed9074167946501b47edee707/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:45.930946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fb55-1e57-42ac-82e4-acb84f1221b1 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:45.931243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fb55-1e57-42ac-82e4-acb84f1221b1 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:45.931529 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fb55-1e57-42ac-82e4-acb84f1221b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:45.958142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-bc34fb55-1e57-42ac-82e4-acb84f1221b1 None None] MFA Rules not processed for user `3256bb8ed9074167946501b47edee707`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:45.959889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-bc34fb55-1e57-42ac-82e4-acb84f1221b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:45.994581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:46.030669 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1407/2791] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:46.042312 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e522eb6-a55b-4b79-aff6-ebec6452850e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:46.044088 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-1e522eb6-a55b-4b79-aff6-ebec6452850e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:46.100591 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e522eb6-a55b-4b79-aff6-ebec6452850e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:46.104195 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7416b-11a8-4c78-a003-90396a316b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:46.104841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7416b-11a8-4c78-a003-90396a316b5c service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:46.105128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7416b-11a8-4c78-a003-90396a316b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:46.105407 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7416b-11a8-4c78-a003-90396a316b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:46.130801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:46.160376 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7416b-11a8-4c78-a003-90396a316b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:46.162476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7416b-11a8-4c78-a003-90396a316b5c service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:46.171643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1385/2792] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:48.704820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34fb55-1e57-42ac-82e4-acb84f1221b1 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:48.714584 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34fb55-1e57-42ac-82e4-acb84f1221b1 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:48.718157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037bd1-858a-44fd-b47f-21869534e626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:48.718856 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037bd1-858a-44fd-b47f-21869534e626 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:48.719143 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037bd1-858a-44fd-b47f-21869534e626 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:48.719463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037bd1-858a-44fd-b47f-21869534e626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:48.728824 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37037bd1-858a-44fd-b47f-21869534e626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:48.730243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37037bd1-858a-44fd-b47f-21869534e626 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:48.739563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1408/2793] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:56.167587 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=15 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:57.374263 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7416b-11a8-4c78-a003-90396a316b5c service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:57.377189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c6c7416b-11a8-4c78-a003-90396a316b5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:57.494676 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7416b-11a8-4c78-a003-90396a316b5c service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:57.500856 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a46344-f6c1-465b-a0e3-e8bd08247cb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:57.501755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46344-f6c1-465b-a0e3-e8bd08247cb0 service placement] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:57.502155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46344-f6c1-465b-a0e3-e8bd08247cb0 service placement] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:57.502789 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46344-f6c1-465b-a0e3-e8bd08247cb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:57.504950 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-71a46344-f6c1-465b-a0e3-e8bd08247cb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:57.519065 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a46344-f6c1-465b-a0e3-e8bd08247cb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:57.520645 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a46344-f6c1-465b-a0e3-e8bd08247cb0 service placement] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:57.532183 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1386/2794] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:43:58.181257 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037bd1-858a-44fd-b47f-21869534e626 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:58.182711 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-37037bd1-858a-44fd-b47f-21869534e626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:58.247329 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037bd1-858a-44fd-b47f-21869534e626 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:58.251805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:58.252659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:58.252941 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:58.253212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] PATH_INFO: `/v3/users/cb0ad6084f424249a382abc6c03d4f05` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:58.254393 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0ad6084f424249a382abc6c03d4f05)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:58.256302 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:58.302346 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0ad6084f424249a382abc6c03d4f05'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.303009 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0ad6084f424249a382abc6c03d4f05'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.310316 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0ad6084f424249a382abc6c03d4f05'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.331120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0ad6084f424249a382abc6c03d4f05'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.338522 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0ad6084f424249a382abc6c03d4f05'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.344480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1409/2795] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:58 2022] DELETE /identity/v3/users/cb0ad6084f424249a382abc6c03d4f05 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:58.511284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a46344-f6c1-465b-a0e3-e8bd08247cb0 service placement] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:58.522141 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a46344-f6c1-465b-a0e3-e8bd08247cb0 service placement] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:58.591572 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:58.592475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:58.592762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:58.593039 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] PATH_INFO: `/v3/projects/a12c2ee4ca2d496e850c6052e693cb02` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:58.594250 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12c2ee4ca2d496e850c6052e693cb02)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:58.596226 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:58.652946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12c2ee4ca2d496e850c6052e693cb02', 'request_id': 'req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.658327 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12c2ee4ca2d496e850c6052e693cb02', 'request_id': 'req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.664762 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12c2ee4ca2d496e850c6052e693cb02', 'request_id': 'req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.678396 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] The token cache is being invalidate because project a12c2ee4ca2d496e850c6052e693cb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:58.678804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.679971 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.681765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1387/2796] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:58 2022] DELETE /identity/v3/projects/a12c2ee4ca2d496e850c6052e693cb02 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:58.687944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:58.689365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:58.703566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e00572-d5ff-480b-b30a-c8ed71c09f58 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:58.738617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:58.768029 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:58.768909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:58.769193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:58.769468 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] PATH_INFO: `/v3/users/d65c167bcdb3455fb99cd331d7a0125b` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:58.770707 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65c167bcdb3455fb99cd331d7a0125b)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:58.772664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:58.822088 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65c167bcdb3455fb99cd331d7a0125b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.822759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65c167bcdb3455fb99cd331d7a0125b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.830258 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65c167bcdb3455fb99cd331d7a0125b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.843163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65c167bcdb3455fb99cd331d7a0125b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.850438 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a70eee45-fbc0-4bf8-92c2-32b8f77325c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65c167bcdb3455fb99cd331d7a0125b'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:58.856572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1410/2797] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:43:58 2022] DELETE /identity/v3/users/d65c167bcdb3455fb99cd331d7a0125b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:59.041175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:59.042898 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:59.058223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca77d4-638c-4bcb-9e0c-7e6cfadf6dce admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:59.076290 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:59.118566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:59.119672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.119958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.120232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] PATH_INFO: `/v3/projects/9b0bc5bd1b9948658f2d19496caa6573` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.121410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0bc5bd1b9948658f2d19496caa6573)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:59.123347 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:59.167565 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0bc5bd1b9948658f2d19496caa6573', 'request_id': 'req-b2b29c2e-049e-455f-8e94-3b59120e0dab'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:59.173026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0bc5bd1b9948658f2d19496caa6573', 'request_id': 'req-b2b29c2e-049e-455f-8e94-3b59120e0dab'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:59.179035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0bc5bd1b9948658f2d19496caa6573', 'request_id': 'req-b2b29c2e-049e-455f-8e94-3b59120e0dab'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:59.191420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] The token cache is being invalidate because project 9b0bc5bd1b9948658f2d19496caa6573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:43:59.191736 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:59.192347 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-b2b29c2e-049e-455f-8e94-3b59120e0dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:43:59.193835 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1388/2798] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:43:59 2022] DELETE /identity/v3/projects/9b0bc5bd1b9948658f2d19496caa6573 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:43:59.198916 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b00b5-2d22-4de7-940e-f146f91039b6 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.199403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b00b5-2d22-4de7-940e-f146f91039b6 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.199503 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b00b5-2d22-4de7-940e-f146f91039b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.216654 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a76b00b5-2d22-4de7-940e-f146f91039b6 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:59.217841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a76b00b5-2d22-4de7-940e-f146f91039b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:59.275365 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1411/2799] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:59.283284 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d971116-3f92-4668-81ba-e8410f187f17 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.283570 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d971116-3f92-4668-81ba-e8410f187f17 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.283847 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d971116-3f92-4668-81ba-e8410f187f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.302025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-3d971116-3f92-4668-81ba-e8410f187f17 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:59.303324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3d971116-3f92-4668-81ba-e8410f187f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:59.311082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1389/2800] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:59.315214 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b00b5-2d22-4de7-940e-f146f91039b6 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:59.324815 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b00b5-2d22-4de7-940e-f146f91039b6 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:59.329357 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866daf25-591e-4ab9-8820-7002a492eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:59.330006 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866daf25-591e-4ab9-8820-7002a492eb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.330323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866daf25-591e-4ab9-8820-7002a492eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.330631 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866daf25-591e-4ab9-8820-7002a492eb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.331366 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866daf25-591e-4ab9-8820-7002a492eb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:43:59.331674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866daf25-591e-4ab9-8820-7002a492eb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:59.333270 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866daf25-591e-4ab9-8820-7002a492eb53 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:59.345352 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1412/2801] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:43:59.349797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d971116-3f92-4668-81ba-e8410f187f17 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:59.359475 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d971116-3f92-4668-81ba-e8410f187f17 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:59.364255 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8047f3-64bf-45e4-8465-2bfb2d7b7f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:59.364892 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8047f3-64bf-45e4-8465-2bfb2d7b7f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.365174 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8047f3-64bf-45e4-8465-2bfb2d7b7f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.365448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8047f3-64bf-45e4-8465-2bfb2d7b7f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.366149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8047f3-64bf-45e4-8465-2bfb2d7b7f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:59.368091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8047f3-64bf-45e4-8465-2bfb2d7b7f8f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:59.394520 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1390/2802] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:43:59 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:59.399153 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866daf25-591e-4ab9-8820-7002a492eb53 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:59.409196 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866daf25-591e-4ab9-8820-7002a492eb53 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:59.453229 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:59.470600 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441256fc-39d7-482a-bbc5-429559fc16b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:59.471300 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441256fc-39d7-482a-bbc5-429559fc16b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.471587 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441256fc-39d7-482a-bbc5-429559fc16b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.471867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441256fc-39d7-482a-bbc5-429559fc16b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.472566 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441256fc-39d7-482a-bbc5-429559fc16b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:59.474532 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441256fc-39d7-482a-bbc5-429559fc16b2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:59.494224 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1413/2803] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:43:59 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:43:59.498640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8047f3-64bf-45e4-8465-2bfb2d7b7f8f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:59.509052 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8047f3-64bf-45e4-8465-2bfb2d7b7f8f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:59.513603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8fc42-ac06-4fdc-bae0-05d23044875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:59.514259 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8fc42-ac06-4fdc-bae0-05d23044875c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.514573 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8fc42-ac06-4fdc-bae0-05d23044875c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.514848 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8fc42-ac06-4fdc-bae0-05d23044875c admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.515564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8fc42-ac06-4fdc-bae0-05d23044875c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:59.517140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8fc42-ac06-4fdc-bae0-05d23044875c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:59.527861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1391/2804] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:59.531613 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441256fc-39d7-482a-bbc5-429559fc16b2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:59.542159 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441256fc-39d7-482a-bbc5-429559fc16b2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:59.546742 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2d669-af44-446c-9e79-7e5508bf2604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:59.547389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d669-af44-446c-9e79-7e5508bf2604 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.547674 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d669-af44-446c-9e79-7e5508bf2604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.547948 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d669-af44-446c-9e79-7e5508bf2604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.548668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2d669-af44-446c-9e79-7e5508bf2604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:59.550236 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2d669-af44-446c-9e79-7e5508bf2604 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:59.560193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1414/2805] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:43:59.564203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8fc42-ac06-4fdc-bae0-05d23044875c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:59.574104 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8fc42-ac06-4fdc-bae0-05d23044875c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:59.578693 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f341d2-bd03-4019-90eb-2beb0534d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:59.579553 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f341d2-bd03-4019-90eb-2beb0534d4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.579833 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f341d2-bd03-4019-90eb-2beb0534d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.580107 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f341d2-bd03-4019-90eb-2beb0534d4ef admin admin] PATH_INFO: `/v3/projects/f5351dbf43134e58b90ff605bbd5e59d/users/e72fe2a3eb314c8bbf9c16146644e558/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.594630 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f341d2-bd03-4019-90eb-2beb0534d4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5351dbf43134e58b90ff605bbd5e59d, user_id=e72fe2a3eb314c8bbf9c16146644e558, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:59.597251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f341d2-bd03-4019-90eb-2beb0534d4ef admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:59.610010 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1392/2806] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:43:59 2022] PUT /identity/v3/projects/f5351dbf43134e58b90ff605bbd5e59d/users/e72fe2a3eb314c8bbf9c16146644e558/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:43:59.620210 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf09a4c-9de4-4046-981e-175b8749a684 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.620518 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf09a4c-9de4-4046-981e-175b8749a684 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.620783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf09a4c-9de4-4046-981e-175b8749a684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.646914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-2bf09a4c-9de4-4046-981e-175b8749a684 None None] MFA Rules not processed for user `e72fe2a3eb314c8bbf9c16146644e558`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:43:59.648125 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2bf09a4c-9de4-4046-981e-175b8749a684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:59.711848 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1415/2807] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:43:59.722282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f341d2-bd03-4019-90eb-2beb0534d4ef admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:43:59.723986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-84f341d2-bd03-4019-90eb-2beb0534d4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:43:59.775126 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:43:59.781333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f341d2-bd03-4019-90eb-2beb0534d4ef admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:43:59.785772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e6edb-653b-4c60-837c-13841e77fdd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:43:59.786512 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e6edb-653b-4c60-837c-13841e77fdd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:43:59.786967 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e6edb-653b-4c60-837c-13841e77fdd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:43:59.787248 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e6edb-653b-4c60-837c-13841e77fdd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:43:59.795656 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e6edb-653b-4c60-837c-13841e77fdd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:43:59.797080 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e6edb-653b-4c60-837c-13841e77fdd2 service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:43:59.805956 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1393/2808] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:43:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:01.165490 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf09a4c-9de4-4046-981e-175b8749a684 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:01.166915 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2bf09a4c-9de4-4046-981e-175b8749a684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:01.233036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf09a4c-9de4-4046-981e-175b8749a684 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:01.237500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:01.238375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:01.238666 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:01.238939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] PATH_INFO: `/v3/users/493ee4528dec49ecbd3a6c63946a9a6e` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:01.240115 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] RBAC: Authorizing `identity:delete_user(user_id=493ee4528dec49ecbd3a6c63946a9a6e)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:01.242137 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:01.290574 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493ee4528dec49ecbd3a6c63946a9a6e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:01.291259 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493ee4528dec49ecbd3a6c63946a9a6e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:01.299063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493ee4528dec49ecbd3a6c63946a9a6e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:01.300239 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:01.312831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493ee4528dec49ecbd3a6c63946a9a6e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:01.320531 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493ee4528dec49ecbd3a6c63946a9a6e'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:01.326891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1416/2809] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:01 2022] DELETE /identity/v3/users/493ee4528dec49ecbd3a6c63946a9a6e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:01.332085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de637a-4f1f-4974-a693-6768bfe0d363 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:01.332567 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de637a-4f1f-4974-a693-6768bfe0d363 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:01.332688 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de637a-4f1f-4974-a693-6768bfe0d363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:01.350288 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-26de637a-4f1f-4974-a693-6768bfe0d363 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:01.351536 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-26de637a-4f1f-4974-a693-6768bfe0d363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:01.415218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1394/2810] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:01.425117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:01.426541 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:01.493031 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c854b9a-18c8-4153-be32-eb03bf2b212a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:01.497013 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ad17e-2314-44b5-91f9-8f6bb522559e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:01.497697 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ad17e-2314-44b5-91f9-8f6bb522559e service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:01.497978 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ad17e-2314-44b5-91f9-8f6bb522559e service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:01.498253 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ad17e-2314-44b5-91f9-8f6bb522559e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:01.508410 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ad17e-2314-44b5-91f9-8f6bb522559e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:01.509829 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ad17e-2314-44b5-91f9-8f6bb522559e service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:01.526558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1417/2811] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:44:01.783914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de637a-4f1f-4974-a693-6768bfe0d363 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:01.785416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-26de637a-4f1f-4974-a693-6768bfe0d363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:01.797822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de637a-4f1f-4974-a693-6768bfe0d363 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:01.802526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:01.803387 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:01.803668 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:01.803945 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] PATH_INFO: `/v3/projects/97ba7e122fe14f949c3732c267e9c042` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:01.805700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ba7e122fe14f949c3732c267e9c042)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:01.807633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:01.853571 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ba7e122fe14f949c3732c267e9c042', 'request_id': 'req-32299aee-2aea-4748-9154-f32eaea606c3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:01.858951 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ba7e122fe14f949c3732c267e9c042', 'request_id': 'req-32299aee-2aea-4748-9154-f32eaea606c3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:01.864909 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ba7e122fe14f949c3732c267e9c042', 'request_id': 'req-32299aee-2aea-4748-9154-f32eaea606c3'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:01.878364 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] The token cache is being invalidate because project 97ba7e122fe14f949c3732c267e9c042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:01.878660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:01.879280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:01.880796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1395/2812] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:01 2022] DELETE /identity/v3/projects/97ba7e122fe14f949c3732c267e9c042 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:01.885411 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ad17e-2314-44b5-91f9-8f6bb522559e service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:01.895105 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ad17e-2314-44b5-91f9-8f6bb522559e service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:01.952237 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:01.953052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:01.953337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:01.953617 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] PATH_INFO: `/v3/users/3256bb8ed9074167946501b47edee707` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:01.954853 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3256bb8ed9074167946501b47edee707)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:01.957094 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:02.003581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3256bb8ed9074167946501b47edee707'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:02.004232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3256bb8ed9074167946501b47edee707'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:02.011413 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3256bb8ed9074167946501b47edee707'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:02.023130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3256bb8ed9074167946501b47edee707'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:02.027546 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:02.031862 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-28a2465c-0055-476c-919e-894c666c38ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3256bb8ed9074167946501b47edee707'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:02.039481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1418/2813] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:01 2022] DELETE /identity/v3/users/3256bb8ed9074167946501b47edee707 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:02.307586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:02.309253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:02.324297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32299aee-2aea-4748-9154-f32eaea606c3 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:02.383936 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:02.384797 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:02.385083 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:02.385362 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] PATH_INFO: `/v3/projects/ca8050fbc66844f5bad27e98049b8d0d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:02.386560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8050fbc66844f5bad27e98049b8d0d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:02.388449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:02.404220 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:02.435759 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8050fbc66844f5bad27e98049b8d0d', 'request_id': 'req-4217be5f-4c29-46a1-bdc1-5c887f96732a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:02.441199 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8050fbc66844f5bad27e98049b8d0d', 'request_id': 'req-4217be5f-4c29-46a1-bdc1-5c887f96732a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:02.447503 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8050fbc66844f5bad27e98049b8d0d', 'request_id': 'req-4217be5f-4c29-46a1-bdc1-5c887f96732a'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:02.461461 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] The token cache is being invalidate because project ca8050fbc66844f5bad27e98049b8d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:02.461755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:02.462408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-4217be5f-4c29-46a1-bdc1-5c887f96732a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:02.463947 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1396/2814] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:02 2022] DELETE /identity/v3/projects/ca8050fbc66844f5bad27e98049b8d0d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:02.470628 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3ae7f-a020-49eb-9a92-d61595af7903 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:02.471117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3ae7f-a020-49eb-9a92-d61595af7903 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:02.471230 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3ae7f-a020-49eb-9a92-d61595af7903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:02.489686 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-dfb3ae7f-a020-49eb-9a92-d61595af7903 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:02.490871 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-dfb3ae7f-a020-49eb-9a92-d61595af7903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:02.555665 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1419/2815] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:02.563958 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43762170-6fc6-43b5-9a23-351f7f7aed2c None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:02.564251 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43762170-6fc6-43b5-9a23-351f7f7aed2c None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:02.564534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43762170-6fc6-43b5-9a23-351f7f7aed2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:02.583751 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-43762170-6fc6-43b5-9a23-351f7f7aed2c None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:02.584941 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-43762170-6fc6-43b5-9a23-351f7f7aed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:02.593831 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1397/2816] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:02.598045 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3ae7f-a020-49eb-9a92-d61595af7903 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:02.608418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3ae7f-a020-49eb-9a92-d61595af7903 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:02.612998 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63ff6e-5f58-4a89-9927-8555bd1d7f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:02.613947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63ff6e-5f58-4a89-9927-8555bd1d7f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:02.613947 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63ff6e-5f58-4a89-9927-8555bd1d7f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:02.614191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63ff6e-5f58-4a89-9927-8555bd1d7f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:02.614944 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63ff6e-5f58-4a89-9927-8555bd1d7f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:44:02.615255 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63ff6e-5f58-4a89-9927-8555bd1d7f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:02.616838 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63ff6e-5f58-4a89-9927-8555bd1d7f85 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:02.628802 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1420/2817] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:44:02.632883 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43762170-6fc6-43b5-9a23-351f7f7aed2c None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:02.644538 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43762170-6fc6-43b5-9a23-351f7f7aed2c None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:02.649807 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290726-df5d-411b-a7cc-9e668f3c61ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:02.650662 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290726-df5d-411b-a7cc-9e668f3c61ff admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:02.651154 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290726-df5d-411b-a7cc-9e668f3c61ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:02.651628 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290726-df5d-411b-a7cc-9e668f3c61ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:02.652660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c290726-df5d-411b-a7cc-9e668f3c61ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:02.655563 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c290726-df5d-411b-a7cc-9e668f3c61ff admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:02.685685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1398/2818] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:44:02 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:02.687120 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63ff6e-5f58-4a89-9927-8555bd1d7f85 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:02.697805 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63ff6e-5f58-4a89-9927-8555bd1d7f85 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:02.758945 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171e04b-144e-429a-804c-a70a713443b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:02.759621 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171e04b-144e-429a-804c-a70a713443b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:02.759908 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171e04b-144e-429a-804c-a70a713443b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:02.760189 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171e04b-144e-429a-804c-a70a713443b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:02.760893 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171e04b-144e-429a-804c-a70a713443b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:02.762827 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171e04b-144e-429a-804c-a70a713443b6 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:02.783516 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1421/2819] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:44:02 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:02.788348 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290726-df5d-411b-a7cc-9e668f3c61ff admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:02.801575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290726-df5d-411b-a7cc-9e668f3c61ff admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:02.806995 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b3472-ad55-4e6d-8839-edd922fabee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:02.807668 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b3472-ad55-4e6d-8839-edd922fabee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:02.807953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b3472-ad55-4e6d-8839-edd922fabee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:02.808234 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b3472-ad55-4e6d-8839-edd922fabee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:02.808965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b3472-ad55-4e6d-8839-edd922fabee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:02.810598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b3472-ad55-4e6d-8839-edd922fabee8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:02.823021 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1399/2820] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:02.826930 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171e04b-144e-429a-804c-a70a713443b6 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:02.838100 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171e04b-144e-429a-804c-a70a713443b6 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:02.843505 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b666f-c895-4a40-afa8-724ef72a734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:02.843818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b666f-c895-4a40-afa8-724ef72a734e admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:02.844107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b666f-c895-4a40-afa8-724ef72a734e admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:02.844389 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b666f-c895-4a40-afa8-724ef72a734e admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:02.845129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b666f-c895-4a40-afa8-724ef72a734e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:02.846990 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b666f-c895-4a40-afa8-724ef72a734e admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:02.858244 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1422/2821] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:02.862505 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b3472-ad55-4e6d-8839-edd922fabee8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:02.873569 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b3472-ad55-4e6d-8839-edd922fabee8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:02.878612 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65dd9-6213-491c-8d2f-183501d8f19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:02.879808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65dd9-6213-491c-8d2f-183501d8f19b admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:02.880100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65dd9-6213-491c-8d2f-183501d8f19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:02.880642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65dd9-6213-491c-8d2f-183501d8f19b admin admin] PATH_INFO: `/v3/projects/6a847c358166413398c6b2889f0fba09/users/fe34a6fbf59b435fbfa35e28ffa36dcf/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:02.897796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f65dd9-6213-491c-8d2f-183501d8f19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a847c358166413398c6b2889f0fba09, user_id=fe34a6fbf59b435fbfa35e28ffa36dcf, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:02.901338 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f65dd9-6213-491c-8d2f-183501d8f19b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:02.915473 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1400/2822] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:02 2022] PUT /identity/v3/projects/6a847c358166413398c6b2889f0fba09/users/fe34a6fbf59b435fbfa35e28ffa36dcf/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:44:02.926983 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548eb41-dbe6-4183-bef8-4d37b19d1705 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:02.927285 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548eb41-dbe6-4183-bef8-4d37b19d1705 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:02.927549 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548eb41-dbe6-4183-bef8-4d37b19d1705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:02.955760 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0548eb41-dbe6-4183-bef8-4d37b19d1705 None None] MFA Rules not processed for user `fe34a6fbf59b435fbfa35e28ffa36dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:02.957015 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0548eb41-dbe6-4183-bef8-4d37b19d1705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:03.003644 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:03.022173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1423/2823] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:44:03.027379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65dd9-6213-491c-8d2f-183501d8f19b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:03.090085 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65dd9-6213-491c-8d2f-183501d8f19b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:03.094701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70fce9-2cb7-42f7-b9cf-a70b622c21c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:03.095348 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70fce9-2cb7-42f7-b9cf-a70b622c21c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:03.095632 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70fce9-2cb7-42f7-b9cf-a70b622c21c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:03.095905 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70fce9-2cb7-42f7-b9cf-a70b622c21c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:03.096590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70fce9-2cb7-42f7-b9cf-a70b622c21c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:03.098487 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70fce9-2cb7-42f7-b9cf-a70b622c21c7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:03.124441 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1401/2824] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:44:03 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:03.128673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548eb41-dbe6-4183-bef8-4d37b19d1705 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:03.140023 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548eb41-dbe6-4183-bef8-4d37b19d1705 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:03.194987 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79deff20-b0ec-40ac-a0e5-0b1d21544f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:03.196181 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deff20-b0ec-40ac-a0e5-0b1d21544f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:03.196466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deff20-b0ec-40ac-a0e5-0b1d21544f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:03.196741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deff20-b0ec-40ac-a0e5-0b1d21544f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:03.197418 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79deff20-b0ec-40ac-a0e5-0b1d21544f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:03.199363 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79deff20-b0ec-40ac-a0e5-0b1d21544f48 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:03.218845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1424/2825] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:44:03 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:03.222253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70fce9-2cb7-42f7-b9cf-a70b622c21c7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:03.232333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70fce9-2cb7-42f7-b9cf-a70b622c21c7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:03.236866 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dff38-95a9-4093-8d77-ebe2fe918429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:03.237516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dff38-95a9-4093-8d77-ebe2fe918429 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:03.237801 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dff38-95a9-4093-8d77-ebe2fe918429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:03.238077 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dff38-95a9-4093-8d77-ebe2fe918429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:03.238828 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dff38-95a9-4093-8d77-ebe2fe918429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:03.240408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dff38-95a9-4093-8d77-ebe2fe918429 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:03.251529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1402/2826] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:03.255687 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79deff20-b0ec-40ac-a0e5-0b1d21544f48 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:03.266102 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79deff20-b0ec-40ac-a0e5-0b1d21544f48 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:03.270618 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3e234-97cb-410b-a1b5-cea3122f5343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:03.271477 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e234-97cb-410b-a1b5-cea3122f5343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:03.271759 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e234-97cb-410b-a1b5-cea3122f5343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:03.272032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3e234-97cb-410b-a1b5-cea3122f5343 admin admin] PATH_INFO: `/v3/projects/770acd38f7e14f06a16111e4aaaca879/users/7e6248a35a014385a7537929806dacbf/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:03.286583 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3e234-97cb-410b-a1b5-cea3122f5343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770acd38f7e14f06a16111e4aaaca879, user_id=7e6248a35a014385a7537929806dacbf, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:03.289241 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3e234-97cb-410b-a1b5-cea3122f5343 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:03.301775 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1425/2827] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:03 2022] PUT /identity/v3/projects/770acd38f7e14f06a16111e4aaaca879/users/7e6248a35a014385a7537929806dacbf/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:03.306241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dff38-95a9-4093-8d77-ebe2fe918429 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:03.316453 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dff38-95a9-4093-8d77-ebe2fe918429 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:03.326005 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:03.376765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a874ff-c0ea-4dfa-af81-59ce9fa15125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:03.377601 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a874ff-c0ea-4dfa-af81-59ce9fa15125 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:03.377854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a874ff-c0ea-4dfa-af81-59ce9fa15125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:03.378150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a874ff-c0ea-4dfa-af81-59ce9fa15125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:03.379042 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a874ff-c0ea-4dfa-af81-59ce9fa15125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:03.380865 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a874ff-c0ea-4dfa-af81-59ce9fa15125 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:03.391108 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1403/2828] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:03.395225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3e234-97cb-410b-a1b5-cea3122f5343 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:03.405318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3e234-97cb-410b-a1b5-cea3122f5343 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:03.409846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa447db-43a6-485d-bf3b-5b3e8ca353af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:03.410750 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa447db-43a6-485d-bf3b-5b3e8ca353af admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:03.411035 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa447db-43a6-485d-bf3b-5b3e8ca353af admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:03.411305 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa447db-43a6-485d-bf3b-5b3e8ca353af admin admin] PATH_INFO: `/v3/projects/770acd38f7e14f06a16111e4aaaca879/users/7e6248a35a014385a7537929806dacbf/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:03.413307 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa447db-43a6-485d-bf3b-5b3e8ca353af admin admin] RBAC: Authorizing `identity:create_grant(project_id=770acd38f7e14f06a16111e4aaaca879, user_id=7e6248a35a014385a7537929806dacbf, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:03.416511 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa447db-43a6-485d-bf3b-5b3e8ca353af admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:03.426335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1426/2829] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:03 2022] PUT /identity/v3/projects/770acd38f7e14f06a16111e4aaaca879/users/7e6248a35a014385a7537929806dacbf/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:03.436740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962109-75ed-4a4b-ab15-a6413952c4bc None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:03.437020 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962109-75ed-4a4b-ab15-a6413952c4bc None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:03.437301 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962109-75ed-4a4b-ab15-a6413952c4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:03.462996 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-b5962109-75ed-4a4b-ab15-a6413952c4bc None None] MFA Rules not processed for user `7e6248a35a014385a7537929806dacbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:03.464210 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b5962109-75ed-4a4b-ab15-a6413952c4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:03.531852 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1404/2830] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:03.545377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa447db-43a6-485d-bf3b-5b3e8ca353af admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:03.547208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-daa447db-43a6-485d-bf3b-5b3e8ca353af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:03.605178 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa447db-43a6-485d-bf3b-5b3e8ca353af admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:03.608725 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae90d-9e6a-44d9-82b6-29ad06ba974b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:03.609358 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae90d-9e6a-44d9-82b6-29ad06ba974b service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:03.609661 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae90d-9e6a-44d9-82b6-29ad06ba974b service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:03.609936 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae90d-9e6a-44d9-82b6-29ad06ba974b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:03.661558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:03.664564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ae90d-9e6a-44d9-82b6-29ad06ba974b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:03.666288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ae90d-9e6a-44d9-82b6-29ad06ba974b service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:03.676291 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1427/2831] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:05.010111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5962109-75ed-4a4b-ab15-a6413952c4bc None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:05.011624 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-b5962109-75ed-4a4b-ab15-a6413952c4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:05.023534 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5962109-75ed-4a4b-ab15-a6413952c4bc None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:05.026976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e1e17-ee3b-4187-8332-cb39e99fd5bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:05.027602 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e1e17-ee3b-4187-8332-cb39e99fd5bb service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:05.027885 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e1e17-ee3b-4187-8332-cb39e99fd5bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:05.028157 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e1e17-ee3b-4187-8332-cb39e99fd5bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:05.039360 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e1e17-ee3b-4187-8332-cb39e99fd5bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:05.040771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e1e17-ee3b-4187-8332-cb39e99fd5bb service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:05.051114 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1405/2832] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:08.784311 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae90d-9e6a-44d9-82b6-29ad06ba974b service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:08.845431 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae90d-9e6a-44d9-82b6-29ad06ba974b service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:08.849890 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:08.850773 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:08.851054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:08.851326 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] PATH_INFO: `/v3/users/fe34a6fbf59b435fbfa35e28ffa36dcf` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:08.852487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe34a6fbf59b435fbfa35e28ffa36dcf)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:08.855025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:08.900762 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe34a6fbf59b435fbfa35e28ffa36dcf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:08.901432 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe34a6fbf59b435fbfa35e28ffa36dcf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:08.908609 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe34a6fbf59b435fbfa35e28ffa36dcf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:08.921017 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe34a6fbf59b435fbfa35e28ffa36dcf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:08.927847 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe34a6fbf59b435fbfa35e28ffa36dcf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:08.934288 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1428/2833] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:08 2022] DELETE /identity/v3/users/fe34a6fbf59b435fbfa35e28ffa36dcf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:08.938837 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c707ab-40da-4686-b42f-477a18cdafeb None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:08.939300 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c707ab-40da-4686-b42f-477a18cdafeb None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:08.939415 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c707ab-40da-4686-b42f-477a18cdafeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:08.956435 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d0c707ab-40da-4686-b42f-477a18cdafeb None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:08.957625 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d0c707ab-40da-4686-b42f-477a18cdafeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:09.014367 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1406/2834] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:09.023745 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:09.025625 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:09.081250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969f00b-4ea1-4976-bf77-39e1ab101df2 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:09.084823 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269ba2e-2244-4c5c-9392-84a18adfde18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:09.085448 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ba2e-2244-4c5c-9392-84a18adfde18 service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:09.085730 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ba2e-2244-4c5c-9392-84a18adfde18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:09.086004 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ba2e-2244-4c5c-9392-84a18adfde18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:09.095406 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269ba2e-2244-4c5c-9392-84a18adfde18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:09.096820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269ba2e-2244-4c5c-9392-84a18adfde18 service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:09.106804 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1429/2835] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:09.367140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c707ab-40da-4686-b42f-477a18cdafeb None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:09.369084 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d0c707ab-40da-4686-b42f-477a18cdafeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:09.381459 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c707ab-40da-4686-b42f-477a18cdafeb None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:09.386702 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:09.387566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:09.387854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:09.388134 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] PATH_INFO: `/v3/projects/6a847c358166413398c6b2889f0fba09` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:09.389323 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a847c358166413398c6b2889f0fba09)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:09.391272 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:09.408243 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=100 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:09.438728 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a847c358166413398c6b2889f0fba09', 'request_id': 'req-11c866ff-c468-4600-b77f-2d9eaab4cdd0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.444068 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a847c358166413398c6b2889f0fba09', 'request_id': 'req-11c866ff-c468-4600-b77f-2d9eaab4cdd0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.450046 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a847c358166413398c6b2889f0fba09', 'request_id': 'req-11c866ff-c468-4600-b77f-2d9eaab4cdd0'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.462784 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] The token cache is being invalidate because project 6a847c358166413398c6b2889f0fba09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:09.463076 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.463699 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.465221 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1407/2836] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:09 2022] DELETE /identity/v3/projects/6a847c358166413398c6b2889f0fba09 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:09.469095 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269ba2e-2244-4c5c-9392-84a18adfde18 service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:09.479243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269ba2e-2244-4c5c-9392-84a18adfde18 service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:09.491191 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:09.537071 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:09.537931 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:09.538212 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:09.538525 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] PATH_INFO: `/v3/users/7e6248a35a014385a7537929806dacbf` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:09.539689 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6248a35a014385a7537929806dacbf)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:09.542208 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:09.575652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:09.577203 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:09.590621 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c866ff-c468-4600-b77f-2d9eaab4cdd0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:09.592108 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6248a35a014385a7537929806dacbf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.592744 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6248a35a014385a7537929806dacbf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.594964 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:09.595827 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:09.596112 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:09.596387 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] PATH_INFO: `/v3/users/e72fe2a3eb314c8bbf9c16146644e558` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:09.597957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72fe2a3eb314c8bbf9c16146644e558)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:09.600542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:09.600821 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6248a35a014385a7537929806dacbf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.613530 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6248a35a014385a7537929806dacbf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.621715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4143e671-1df2-4e8e-85a1-1b293cc1c574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6248a35a014385a7537929806dacbf'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.628211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1430/2837] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:09 2022] DELETE /identity/v3/users/7e6248a35a014385a7537929806dacbf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:09.651391 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72fe2a3eb314c8bbf9c16146644e558'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.652131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72fe2a3eb314c8bbf9c16146644e558'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.652868 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72fe2a3eb314c8bbf9c16146644e558'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.666152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72fe2a3eb314c8bbf9c16146644e558'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.673012 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72fe2a3eb314c8bbf9c16146644e558'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:09.687074 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1408/2838] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:09 2022] DELETE /identity/v3/users/e72fe2a3eb314c8bbf9c16146644e558 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:09.691764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22133a46-deeb-4dad-a43c-5cebca1d757d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:09.692086 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22133a46-deeb-4dad-a43c-5cebca1d757d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:09.692372 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22133a46-deeb-4dad-a43c-5cebca1d757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:09.712128 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-22133a46-deeb-4dad-a43c-5cebca1d757d None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:09.714060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-22133a46-deeb-4dad-a43c-5cebca1d757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:09.782215 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1431/2839] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:09.788926 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:09.790416 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:09.852716 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77bdf4-4c81-42d7-8548-2ade87e738e5 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:09.856861 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff89670-e86f-43f5-8ee8-b1c940cbc70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:09.857586 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff89670-e86f-43f5-8ee8-b1c940cbc70e service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:09.857953 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff89670-e86f-43f5-8ee8-b1c940cbc70e service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:09.858331 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff89670-e86f-43f5-8ee8-b1c940cbc70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:09.868233 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff89670-e86f-43f5-8ee8-b1c940cbc70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:09.870566 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff89670-e86f-43f5-8ee8-b1c940cbc70e service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:09.881528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1409/2840] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:09.913089 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22133a46-deeb-4dad-a43c-5cebca1d757d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:09.914820 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-22133a46-deeb-4dad-a43c-5cebca1d757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:09.929586 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22133a46-deeb-4dad-a43c-5cebca1d757d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:09.937378 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:09.939692 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:09.940042 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:09.940399 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] PATH_INFO: `/v3/projects/770acd38f7e14f06a16111e4aaaca879` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:09.942136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] RBAC: Authorizing `identity:delete_project(project_id=770acd38f7e14f06a16111e4aaaca879)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:09.945166 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:09.992177 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:10.007536 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770acd38f7e14f06a16111e4aaaca879', 'request_id': 'req-c2dee7dc-c987-4a90-8191-b4936ebc474d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:10.015263 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770acd38f7e14f06a16111e4aaaca879', 'request_id': 'req-c2dee7dc-c987-4a90-8191-b4936ebc474d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:10.020889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770acd38f7e14f06a16111e4aaaca879', 'request_id': 'req-c2dee7dc-c987-4a90-8191-b4936ebc474d'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:10.032648 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] The token cache is being invalidate because project 770acd38f7e14f06a16111e4aaaca879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:10.032932 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:10.033589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-c2dee7dc-c987-4a90-8191-b4936ebc474d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:10.035178 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1432/2841] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:09 2022] DELETE /identity/v3/projects/770acd38f7e14f06a16111e4aaaca879 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:10.040216 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f699a-7090-4c0d-a543-eefc7aea8ba3 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.041260 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f699a-7090-4c0d-a543-eefc7aea8ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.041428 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f699a-7090-4c0d-a543-eefc7aea8ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.065138 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-481f699a-7090-4c0d-a543-eefc7aea8ba3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:10.066404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-481f699a-7090-4c0d-a543-eefc7aea8ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:10.080093 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:10.130749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1410/2842] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:10.139879 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17961f-9065-4f5d-be0b-b9ff6145c669 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.140315 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17961f-9065-4f5d-be0b-b9ff6145c669 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.140604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17961f-9065-4f5d-be0b-b9ff6145c669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.162436 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-0e17961f-9065-4f5d-be0b-b9ff6145c669 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:10.163668 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0e17961f-9065-4f5d-be0b-b9ff6145c669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:10.173142 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1433/2843] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:10.177775 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f699a-7090-4c0d-a543-eefc7aea8ba3 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.177950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17961f-9065-4f5d-be0b-b9ff6145c669 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.179175 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-0e17961f-9065-4f5d-be0b-b9ff6145c669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:10.189030 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f699a-7090-4c0d-a543-eefc7aea8ba3 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.193873 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217042b7-ef01-4fa4-b2b8-71291ec0e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.194660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217042b7-ef01-4fa4-b2b8-71291ec0e26e admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.195017 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217042b7-ef01-4fa4-b2b8-71291ec0e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.195302 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217042b7-ef01-4fa4-b2b8-71291ec0e26e admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.196032 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217042b7-ef01-4fa4-b2b8-71291ec0e26e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:44:10.196344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217042b7-ef01-4fa4-b2b8-71291ec0e26e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.198533 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217042b7-ef01-4fa4-b2b8-71291ec0e26e admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.199753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17961f-9065-4f5d-be0b-b9ff6145c669 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.205408 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.206972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.207154 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.207452 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] PATH_INFO: `/v3/projects/f5351dbf43134e58b90ff605bbd5e59d` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.209062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5351dbf43134e58b90ff605bbd5e59d)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.211207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.216819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1411/2844] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:44:10.217893 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217042b7-ef01-4fa4-b2b8-71291ec0e26e admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.227812 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217042b7-ef01-4fa4-b2b8-71291ec0e26e admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.232667 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ff878-9a6b-413d-8cf1-fbb2738074a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.233496 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ff878-9a6b-413d-8cf1-fbb2738074a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.233881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ff878-9a6b-413d-8cf1-fbb2738074a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.234279 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ff878-9a6b-413d-8cf1-fbb2738074a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.235130 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ff878-9a6b-413d-8cf1-fbb2738074a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.237192 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ff878-9a6b-413d-8cf1-fbb2738074a0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.260435 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5351dbf43134e58b90ff605bbd5e59d', 'request_id': 'req-4b6116b0-f28d-4267-a4be-5b7703b13ef0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:10.268986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1412/2845] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:44:10 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:10.269167 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5351dbf43134e58b90ff605bbd5e59d', 'request_id': 'req-4b6116b0-f28d-4267-a4be-5b7703b13ef0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:10.270508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ff878-9a6b-413d-8cf1-fbb2738074a0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.274163 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5351dbf43134e58b90ff605bbd5e59d', 'request_id': 'req-4b6116b0-f28d-4267-a4be-5b7703b13ef0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:10.286717 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] The token cache is being invalidate because project f5351dbf43134e58b90ff605bbd5e59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:10.287011 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:10.287685 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:10.289242 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1434/2846] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:10 2022] DELETE /identity/v3/projects/f5351dbf43134e58b90ff605bbd5e59d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:44:10.338786 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ff878-9a6b-413d-8cf1-fbb2738074a0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.343424 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7329c0-8ff4-4e37-ab2f-06bc988098ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.344101 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7329c0-8ff4-4e37-ab2f-06bc988098ae admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.344380 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7329c0-8ff4-4e37-ab2f-06bc988098ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.344652 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7329c0-8ff4-4e37-ab2f-06bc988098ae admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.345371 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7329c0-8ff4-4e37-ab2f-06bc988098ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.347339 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7329c0-8ff4-4e37-ab2f-06bc988098ae admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.373282 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1413/2847] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:44:10 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 10:44:10.374486 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.375914 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:10.443806 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6116b0-f28d-4267-a4be-5b7703b13ef0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.452160 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d387-1060-4641-9bcc-633d9f45e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.452851 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d387-1060-4641-9bcc-633d9f45e01c admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.453133 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d387-1060-4641-9bcc-633d9f45e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.453437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0d387-1060-4641-9bcc-633d9f45e01c admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.454297 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0d387-1060-4641-9bcc-633d9f45e01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.455855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0d387-1060-4641-9bcc-633d9f45e01c admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.468604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1435/2848] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:44:10.472808 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7329c0-8ff4-4e37-ab2f-06bc988098ae admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.484524 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7329c0-8ff4-4e37-ab2f-06bc988098ae admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.489333 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d54af-4a2a-4318-95f2-5fb77df540e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.490109 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d54af-4a2a-4318-95f2-5fb77df540e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.490498 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d54af-4a2a-4318-95f2-5fb77df540e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.490841 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d54af-4a2a-4318-95f2-5fb77df540e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.491643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d54af-4a2a-4318-95f2-5fb77df540e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.493326 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d54af-4a2a-4318-95f2-5fb77df540e9 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.505217 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1414/2849] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 10:44:10.510063 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d387-1060-4641-9bcc-633d9f45e01c admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.520780 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0d387-1060-4641-9bcc-633d9f45e01c admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.525538 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b499e-43df-42bc-ad3f-b291c626734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.526475 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b499e-43df-42bc-ad3f-b291c626734d admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.526761 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b499e-43df-42bc-ad3f-b291c626734d admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.527038 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b499e-43df-42bc-ad3f-b291c626734d admin admin] PATH_INFO: `/v3/projects/3b73fe76af4c407f8c38c7b904256bcb/users/457d9c37c10c4e9ea2d8fdc043682834/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.542567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b499e-43df-42bc-ad3f-b291c626734d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b73fe76af4c407f8c38c7b904256bcb, user_id=457d9c37c10c4e9ea2d8fdc043682834, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.545223 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b499e-43df-42bc-ad3f-b291c626734d admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.558279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1436/2850] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:10 2022] PUT /identity/v3/projects/3b73fe76af4c407f8c38c7b904256bcb/users/457d9c37c10c4e9ea2d8fdc043682834/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:10.569173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a6c64-2380-4616-9eb9-00dfbee37d85 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.569467 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a6c64-2380-4616-9eb9-00dfbee37d85 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.569748 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a6c64-2380-4616-9eb9-00dfbee37d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.596287 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-d57a6c64-2380-4616-9eb9-00dfbee37d85 None None] MFA Rules not processed for user `457d9c37c10c4e9ea2d8fdc043682834`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:10.597412 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-d57a6c64-2380-4616-9eb9-00dfbee37d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:10.650230 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:10.661196 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1415/2851] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:10.665636 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b499e-43df-42bc-ad3f-b291c626734d admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.678193 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:10.733218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b499e-43df-42bc-ad3f-b291c626734d admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.737794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7d195-e846-47d8-9eae-f95e948e5a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.738564 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7d195-e846-47d8-9eae-f95e948e5a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.738849 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7d195-e846-47d8-9eae-f95e948e5a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.739126 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7d195-e846-47d8-9eae-f95e948e5a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.739819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7d195-e846-47d8-9eae-f95e948e5a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.741698 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7d195-e846-47d8-9eae-f95e948e5a99 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.767385 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1437/2852] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:44:10 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:10.771374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a6c64-2380-4616-9eb9-00dfbee37d85 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.781880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a6c64-2380-4616-9eb9-00dfbee37d85 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.835946 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75064680-e42a-472e-b6d0-867d8698eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.836598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064680-e42a-472e-b6d0-867d8698eae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.836881 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064680-e42a-472e-b6d0-867d8698eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.837169 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064680-e42a-472e-b6d0-867d8698eae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.837849 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75064680-e42a-472e-b6d0-867d8698eae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.839760 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75064680-e42a-472e-b6d0-867d8698eae0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.859204 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1416/2853] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:44:10 2022] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:10.863094 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7d195-e846-47d8-9eae-f95e948e5a99 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.874033 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7d195-e846-47d8-9eae-f95e948e5a99 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.878553 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7b918-2d06-48d8-9d52-8a70845048a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.879205 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7b918-2d06-48d8-9d52-8a70845048a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.879487 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7b918-2d06-48d8-9d52-8a70845048a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.879763 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7b918-2d06-48d8-9d52-8a70845048a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.880480 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7b918-2d06-48d8-9d52-8a70845048a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.882072 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7b918-2d06-48d8-9d52-8a70845048a0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.893232 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1438/2854] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:10.897046 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75064680-e42a-472e-b6d0-867d8698eae0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.906924 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75064680-e42a-472e-b6d0-867d8698eae0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:10.911476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ebe7-7e12-421d-b339-6197702ab96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:10.912325 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ebe7-7e12-421d-b339-6197702ab96c admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:10.912605 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ebe7-7e12-421d-b339-6197702ab96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:10.912876 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ebe7-7e12-421d-b339-6197702ab96c admin admin] PATH_INFO: `/v3/projects/62052242c223452bb1d4da973e6eb66d/users/a6f333f874b348ed8c72c51c4b2e0cad/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:10.927713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ebe7-7e12-421d-b339-6197702ab96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62052242c223452bb1d4da973e6eb66d, user_id=a6f333f874b348ed8c72c51c4b2e0cad, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:10.930336 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ebe7-7e12-421d-b339-6197702ab96c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:10.944774 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1417/2855] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:10 2022] PUT /identity/v3/projects/62052242c223452bb1d4da973e6eb66d/users/a6f333f874b348ed8c72c51c4b2e0cad/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:10.949243 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7b918-2d06-48d8-9d52-8a70845048a0 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:10.959737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7b918-2d06-48d8-9d52-8a70845048a0 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:11.014562 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc2b25-531c-49f3-a2de-04543538bf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:11.015219 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc2b25-531c-49f3-a2de-04543538bf24 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:11.015500 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc2b25-531c-49f3-a2de-04543538bf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:11.015772 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc2b25-531c-49f3-a2de-04543538bf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:11.016481 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc2b25-531c-49f3-a2de-04543538bf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:11.018056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc2b25-531c-49f3-a2de-04543538bf24 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:11.028060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1439/2856] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:11.032153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ebe7-7e12-421d-b339-6197702ab96c admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:11.042477 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ebe7-7e12-421d-b339-6197702ab96c admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:11.047099 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fcac4-b673-44fe-be73-6d2dee0a421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:11.047969 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcac4-b673-44fe-be73-6d2dee0a421a admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:11.048256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcac4-b673-44fe-be73-6d2dee0a421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:11.048537 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcac4-b673-44fe-be73-6d2dee0a421a admin admin] PATH_INFO: `/v3/projects/62052242c223452bb1d4da973e6eb66d/users/a6f333f874b348ed8c72c51c4b2e0cad/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:11.050560 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fcac4-b673-44fe-be73-6d2dee0a421a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62052242c223452bb1d4da973e6eb66d, user_id=a6f333f874b348ed8c72c51c4b2e0cad, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:11.053191 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fcac4-b673-44fe-be73-6d2dee0a421a admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:11.063310 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1418/2857] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:11 2022] PUT /identity/v3/projects/62052242c223452bb1d4da973e6eb66d/users/a6f333f874b348ed8c72c51c4b2e0cad/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:11.073379 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d914b4-31a6-43ee-bc0c-2e7a35161a4d None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:11.073757 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d914b4-31a6-43ee-bc0c-2e7a35161a4d None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:11.074036 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d914b4-31a6-43ee-bc0c-2e7a35161a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:11.099875 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-a7d914b4-31a6-43ee-bc0c-2e7a35161a4d None None] MFA Rules not processed for user `a6f333f874b348ed8c72c51c4b2e0cad`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:11.101065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-a7d914b4-31a6-43ee-bc0c-2e7a35161a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:11.167278 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1440/2858] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:11.178390 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fcac4-b673-44fe-be73-6d2dee0a421a admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:11.180113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-079fcac4-b673-44fe-be73-6d2dee0a421a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:11.235739 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fcac4-b673-44fe-be73-6d2dee0a421a admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:11.239395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1d0e7-b0cf-493a-a854-0aeeb5fb522e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:11.240033 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1d0e7-b0cf-493a-a854-0aeeb5fb522e service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:11.240315 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1d0e7-b0cf-493a-a854-0aeeb5fb522e service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:11.240590 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1d0e7-b0cf-493a-a854-0aeeb5fb522e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:11.250175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1d0e7-b0cf-493a-a854-0aeeb5fb522e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:11.251618 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1d0e7-b0cf-493a-a854-0aeeb5fb522e service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:11.260819 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1419/2859] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:11.323339 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d914b4-31a6-43ee-bc0c-2e7a35161a4d None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:11.328851 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:11.386610 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d914b4-31a6-43ee-bc0c-2e7a35161a4d None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:11.391136 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:11.391997 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:11.392279 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:11.392552 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] PATH_INFO: `/v3/users/457d9c37c10c4e9ea2d8fdc043682834` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:11.393737 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=457d9c37c10c4e9ea2d8fdc043682834)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:11.395682 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:11.439294 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457d9c37c10c4e9ea2d8fdc043682834'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:11.439863 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457d9c37c10c4e9ea2d8fdc043682834'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:11.446872 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457d9c37c10c4e9ea2d8fdc043682834'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:11.458948 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457d9c37c10c4e9ea2d8fdc043682834'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:11.466171 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457d9c37c10c4e9ea2d8fdc043682834'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:11.472028 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1441/2860] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:11 2022] DELETE /identity/v3/users/457d9c37c10c4e9ea2d8fdc043682834 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:11.476479 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b6635-745c-49ef-8380-e836eb011c80 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:11.476769 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b6635-745c-49ef-8380-e836eb011c80 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:11.477404 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b6635-745c-49ef-8380-e836eb011c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:11.496111 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-dc3b6635-745c-49ef-8380-e836eb011c80 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:11.497293 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dc3b6635-745c-49ef-8380-e836eb011c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:11.540854 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:11.557589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1420/2861] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:11.567783 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:11.569498 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:11.626284 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fcc69-10a8-4199-9a4b-689d99bbf759 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:11.629889 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba760a-bceb-4451-a16b-ec57c009c83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:11.630557 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba760a-bceb-4451-a16b-ec57c009c83e service neutron] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:11.630841 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba760a-bceb-4451-a16b-ec57c009c83e service neutron] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:11.631116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba760a-bceb-4451-a16b-ec57c009c83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:11.640645 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba760a-bceb-4451-a16b-ec57c009c83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:11.642151 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba760a-bceb-4451-a16b-ec57c009c83e service neutron] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:11.651446 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1442/2862] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 10:44:11.919976 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b6635-745c-49ef-8380-e836eb011c80 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:11.921432 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dc3b6635-745c-49ef-8380-e836eb011c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:11.935253 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b6635-745c-49ef-8380-e836eb011c80 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:11.940343 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:11.941268 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:11.941583 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:11.941862 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] PATH_INFO: `/v3/projects/3b73fe76af4c407f8c38c7b904256bcb` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:11.943100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b73fe76af4c407f8c38c7b904256bcb)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:11.945142 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:11.991700 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b73fe76af4c407f8c38c7b904256bcb', 'request_id': 'req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:11.998163 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b73fe76af4c407f8c38c7b904256bcb', 'request_id': 'req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.004225 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b73fe76af4c407f8c38c7b904256bcb', 'request_id': 'req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.016880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] The token cache is being invalidate because project 3b73fe76af4c407f8c38c7b904256bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:12.017173 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.017798 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.019363 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1421/2863] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:11 2022] DELETE /identity/v3/projects/3b73fe76af4c407f8c38c7b904256bcb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:12.023298 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba760a-bceb-4451-a16b-ec57c009c83e service neutron] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:12.032895 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba760a-bceb-4451-a16b-ec57c009c83e service neutron] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:12.056580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:12.090800 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:12.091662 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:12.091939 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:12.092211 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] PATH_INFO: `/v3/users/a6f333f874b348ed8c72c51c4b2e0cad` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:12.093375 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f333f874b348ed8c72c51c4b2e0cad)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:12.095323 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:12.140272 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f333f874b348ed8c72c51c4b2e0cad'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.140917 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f333f874b348ed8c72c51c4b2e0cad'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.147734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f333f874b348ed8c72c51c4b2e0cad'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.159764 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f333f874b348ed8c72c51c4b2e0cad'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.166741 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-a0b812f1-ec9b-44c1-a825-81042ac5a2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f333f874b348ed8c72c51c4b2e0cad'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.172664 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1443/2864] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:12 2022] DELETE /identity/v3/users/a6f333f874b348ed8c72c51c4b2e0cad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:12.445190 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:12.447337 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:12.467635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7a08b-95f8-4e1c-b4d3-514cf1a92b7d admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:12.524515 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:12.525295 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:12.525580 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:12.525870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] PATH_INFO: `/v3/projects/62052242c223452bb1d4da973e6eb66d` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:12.527056 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62052242c223452bb1d4da973e6eb66d)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:12.528986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:12.574633 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62052242c223452bb1d4da973e6eb66d', 'request_id': 'req-429b29e6-bf5a-4469-9d28-1e6549aa2177'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.580102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62052242c223452bb1d4da973e6eb66d', 'request_id': 'req-429b29e6-bf5a-4469-9d28-1e6549aa2177'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.586175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62052242c223452bb1d4da973e6eb66d', 'request_id': 'req-429b29e6-bf5a-4469-9d28-1e6549aa2177'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.599749 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] The token cache is being invalidate because project 62052242c223452bb1d4da973e6eb66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:12.600046 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.600699 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-429b29e6-bf5a-4469-9d28-1e6549aa2177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:12.602280 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1422/2865] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:12 2022] DELETE /identity/v3/projects/62052242c223452bb1d4da973e6eb66d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:12.607659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663912d9-743b-45ec-ba79-08666fd91cf0 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:12.607952 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663912d9-743b-45ec-ba79-08666fd91cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:12.608235 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663912d9-743b-45ec-ba79-08666fd91cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:12.626207 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-663912d9-743b-45ec-ba79-08666fd91cf0 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:12.627439 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-663912d9-743b-45ec-ba79-08666fd91cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:12.687467 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1444/2866] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:12.696164 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c774dce-732a-4ac5-b278-c2b403daf68a None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:12.696497 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c774dce-732a-4ac5-b278-c2b403daf68a None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:12.697328 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c774dce-732a-4ac5-b278-c2b403daf68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:12.703792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:12.719385 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-8c774dce-732a-4ac5-b278-c2b403daf68a None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:12.720593 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-8c774dce-732a-4ac5-b278-c2b403daf68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:12.728512 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1423/2867] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:12.732724 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663912d9-743b-45ec-ba79-08666fd91cf0 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:12.742319 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663912d9-743b-45ec-ba79-08666fd91cf0 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:12.747808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3889c-1216-4725-9c63-9faef51b753a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:12.748453 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3889c-1216-4725-9c63-9faef51b753a admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:12.748736 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3889c-1216-4725-9c63-9faef51b753a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:12.749008 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3889c-1216-4725-9c63-9faef51b753a admin admin] PATH_INFO: `/v3/domains` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:12.749718 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3889c-1216-4725-9c63-9faef51b753a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:44:12.750022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3889c-1216-4725-9c63-9faef51b753a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:12.751627 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3889c-1216-4725-9c63-9faef51b753a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:12.763463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1445/2868] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 10:44:12.767640 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c774dce-732a-4ac5-b278-c2b403daf68a None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:12.776807 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c774dce-732a-4ac5-b278-c2b403daf68a None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:12.781448 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b2291-1a12-4d18-9ca0-e4b53026524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:12.782087 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b2291-1a12-4d18-9ca0-e4b53026524b admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:12.782395 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b2291-1a12-4d18-9ca0-e4b53026524b admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:12.782677 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b2291-1a12-4d18-9ca0-e4b53026524b admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:12.783365 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b2291-1a12-4d18-9ca0-e4b53026524b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:12.785223 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b2291-1a12-4d18-9ca0-e4b53026524b admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:12.811137 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1424/2869] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:44:12 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:12.814097 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3889c-1216-4725-9c63-9faef51b753a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:12.824457 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3889c-1216-4725-9c63-9faef51b753a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:12.856590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:12.887264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0eea9-adcf-42c7-acc5-45b6144d80ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:12.887937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0eea9-adcf-42c7-acc5-45b6144d80ad admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:12.888233 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0eea9-adcf-42c7-acc5-45b6144d80ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:12.888492 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0eea9-adcf-42c7-acc5-45b6144d80ad admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:12.889168 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0eea9-adcf-42c7-acc5-45b6144d80ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:12.891117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0eea9-adcf-42c7-acc5-45b6144d80ad admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:12.909845 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1446/2870] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:44:12 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:12.913715 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b2291-1a12-4d18-9ca0-e4b53026524b admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:12.924016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b2291-1a12-4d18-9ca0-e4b53026524b admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:12.928589 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d568-5240-4be5-b471-9cc06c6f33b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:12.929235 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d568-5240-4be5-b471-9cc06c6f33b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:12.929518 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d568-5240-4be5-b471-9cc06c6f33b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:12.929792 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d568-5240-4be5-b471-9cc06c6f33b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:12.930539 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d568-5240-4be5-b471-9cc06c6f33b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:12.932626 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d568-5240-4be5-b471-9cc06c6f33b4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:12.942895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1425/2871] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:12.946580 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0eea9-adcf-42c7-acc5-45b6144d80ad admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:12.957276 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0eea9-adcf-42c7-acc5-45b6144d80ad admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:12.961938 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944710a9-6ebc-4c10-a799-6551d345f981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:12.963119 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944710a9-6ebc-4c10-a799-6551d345f981 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:12.963403 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944710a9-6ebc-4c10-a799-6551d345f981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:12.963677 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944710a9-6ebc-4c10-a799-6551d345f981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:12.964423 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944710a9-6ebc-4c10-a799-6551d345f981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:12.966001 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944710a9-6ebc-4c10-a799-6551d345f981 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:12.975950 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1447/2872] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:12.980542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d568-5240-4be5-b471-9cc06c6f33b4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:12.990295 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d568-5240-4be5-b471-9cc06c6f33b4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:12.995262 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7ca09-772f-48a7-9e92-4e00d9f9fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:12.996121 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7ca09-772f-48a7-9e92-4e00d9f9fd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:12.996400 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7ca09-772f-48a7-9e92-4e00d9f9fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:12.996673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7ca09-772f-48a7-9e92-4e00d9f9fd17 admin admin] PATH_INFO: `/v3/projects/b6446bd24e684a39abe418f97adda5a9/users/2072f9c551504e16b45a7267b6551c80/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.010829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7ca09-772f-48a7-9e92-4e00d9f9fd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6446bd24e684a39abe418f97adda5a9, user_id=2072f9c551504e16b45a7267b6551c80, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.013462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7ca09-772f-48a7-9e92-4e00d9f9fd17 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.026685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1426/2873] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:12 2022] PUT /identity/v3/projects/b6446bd24e684a39abe418f97adda5a9/users/2072f9c551504e16b45a7267b6551c80/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:13.037578 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049b22d-8973-4181-9248-70c323fa4b19 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.038043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049b22d-8973-4181-9248-70c323fa4b19 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.038043 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049b22d-8973-4181-9248-70c323fa4b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.065310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-5049b22d-8973-4181-9248-70c323fa4b19 None None] MFA Rules not processed for user `2072f9c551504e16b45a7267b6551c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:13.066581 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-5049b22d-8973-4181-9248-70c323fa4b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:13.129905 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1448/2874] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:13.135113 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7ca09-772f-48a7-9e92-4e00d9f9fd17 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.197278 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7ca09-772f-48a7-9e92-4e00d9f9fd17 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.201890 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2320f06-d1ec-462e-8b87-4123c9a52cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.202564 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2320f06-d1ec-462e-8b87-4123c9a52cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.202851 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2320f06-d1ec-462e-8b87-4123c9a52cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.203128 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2320f06-d1ec-462e-8b87-4123c9a52cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.203803 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2320f06-d1ec-462e-8b87-4123c9a52cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.205689 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2320f06-d1ec-462e-8b87-4123c9a52cb8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.230324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1427/2875] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:44:13 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:13.234384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049b22d-8973-4181-9248-70c323fa4b19 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.245596 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049b22d-8973-4181-9248-70c323fa4b19 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.301443 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1269a6c-e74c-408f-87a8-cdb338800b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.302037 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1269a6c-e74c-408f-87a8-cdb338800b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.302325 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1269a6c-e74c-408f-87a8-cdb338800b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.302639 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1269a6c-e74c-408f-87a8-cdb338800b30 admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.303336 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1269a6c-e74c-408f-87a8-cdb338800b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.305260 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1269a6c-e74c-408f-87a8-cdb338800b30 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.325377 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1449/2876] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:44:13 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:13.329231 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2320f06-d1ec-462e-8b87-4123c9a52cb8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.340123 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2320f06-d1ec-462e-8b87-4123c9a52cb8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.344818 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39b9f6-17f1-44a5-a58a-90d94edb57f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.345476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39b9f6-17f1-44a5-a58a-90d94edb57f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.345761 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39b9f6-17f1-44a5-a58a-90d94edb57f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.346040 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39b9f6-17f1-44a5-a58a-90d94edb57f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.346804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39b9f6-17f1-44a5-a58a-90d94edb57f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.348386 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39b9f6-17f1-44a5-a58a-90d94edb57f4 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.359382 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1428/2877] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:13.363369 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1269a6c-e74c-408f-87a8-cdb338800b30 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.374340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1269a6c-e74c-408f-87a8-cdb338800b30 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.379117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882131d0-1bea-492c-9a6c-94c52e9c1220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.379774 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882131d0-1bea-492c-9a6c-94c52e9c1220 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.380061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882131d0-1bea-492c-9a6c-94c52e9c1220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.380340 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882131d0-1bea-492c-9a6c-94c52e9c1220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.381069 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882131d0-1bea-492c-9a6c-94c52e9c1220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.382700 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882131d0-1bea-492c-9a6c-94c52e9c1220 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.392635 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1450/2878] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:13.396619 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39b9f6-17f1-44a5-a58a-90d94edb57f4 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.406516 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39b9f6-17f1-44a5-a58a-90d94edb57f4 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.411047 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1cf55-de86-455e-8340-614ba9368346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.411904 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1cf55-de86-455e-8340-614ba9368346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.412186 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1cf55-de86-455e-8340-614ba9368346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.412462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1cf55-de86-455e-8340-614ba9368346 admin admin] PATH_INFO: `/v3/projects/e1c72d5ef891486cb0f475112964f762/users/3412bbb161034ab7af68729f7e06c4cf/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.427066 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1cf55-de86-455e-8340-614ba9368346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c72d5ef891486cb0f475112964f762, user_id=3412bbb161034ab7af68729f7e06c4cf, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.429672 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1cf55-de86-455e-8340-614ba9368346 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.443334 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1429/2879] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:13 2022] PUT /identity/v3/projects/e1c72d5ef891486cb0f475112964f762/users/3412bbb161034ab7af68729f7e06c4cf/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 10:44:13.453396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376f70-41a6-4779-aa9e-e0151182fa78 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.453701 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376f70-41a6-4779-aa9e-e0151182fa78 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.454061 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376f70-41a6-4779-aa9e-e0151182fa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.481466 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-f1376f70-41a6-4779-aa9e-e0151182fa78 None None] MFA Rules not processed for user `3412bbb161034ab7af68729f7e06c4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:13.482723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-f1376f70-41a6-4779-aa9e-e0151182fa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:13.490777 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:13.547659 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1451/2880] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:13.552100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1cf55-de86-455e-8340-614ba9368346 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.599806 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:13.614780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1cf55-de86-455e-8340-614ba9368346 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.619449 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201411fc-814d-440d-b0ce-c21c64fabec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.620355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201411fc-814d-440d-b0ce-c21c64fabec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.620642 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201411fc-814d-440d-b0ce-c21c64fabec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.620922 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201411fc-814d-440d-b0ce-c21c64fabec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.621600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201411fc-814d-440d-b0ce-c21c64fabec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.623526 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201411fc-814d-440d-b0ce-c21c64fabec0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.647528 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1430/2881] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:44:13 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:13.652092 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376f70-41a6-4779-aa9e-e0151182fa78 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.662740 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376f70-41a6-4779-aa9e-e0151182fa78 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.719384 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc1888-2ac0-4ce3-9816-32b43e8e63fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.720051 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1888-2ac0-4ce3-9816-32b43e8e63fd admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.720335 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1888-2ac0-4ce3-9816-32b43e8e63fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.720614 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1888-2ac0-4ce3-9816-32b43e8e63fd admin admin] PATH_INFO: `/v3/users` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.721293 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc1888-2ac0-4ce3-9816-32b43e8e63fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.723246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc1888-2ac0-4ce3-9816-32b43e8e63fd admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.742798 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1452/2882] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:44:13 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:13.747057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201411fc-814d-440d-b0ce-c21c64fabec0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.757241 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201411fc-814d-440d-b0ce-c21c64fabec0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.761814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c6e5b-2915-407b-a123-880aeecedec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.762491 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6e5b-2915-407b-a123-880aeecedec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.762775 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6e5b-2915-407b-a123-880aeecedec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.763050 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6e5b-2915-407b-a123-880aeecedec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.763795 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c6e5b-2915-407b-a123-880aeecedec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.765366 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c6e5b-2915-407b-a123-880aeecedec8 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.776146 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1431/2883] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:13.780169 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc1888-2ac0-4ce3-9816-32b43e8e63fd admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.789846 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc1888-2ac0-4ce3-9816-32b43e8e63fd admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.794972 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f1738-7d4c-41bf-ac2d-1d2cf4e71b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.795831 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f1738-7d4c-41bf-ac2d-1d2cf4e71b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.796116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f1738-7d4c-41bf-ac2d-1d2cf4e71b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.796395 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f1738-7d4c-41bf-ac2d-1d2cf4e71b56 admin admin] PATH_INFO: `/v3/projects/3973cffabf1848de972aa1e1a5d74cd8/users/ac2cdd49f5524b30949a03a150018536/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.810816 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f1738-7d4c-41bf-ac2d-1d2cf4e71b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3973cffabf1848de972aa1e1a5d74cd8, user_id=ac2cdd49f5524b30949a03a150018536, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.813397 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f1738-7d4c-41bf-ac2d-1d2cf4e71b56 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.826826 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1453/2884] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:13 2022] PUT /identity/v3/projects/3973cffabf1848de972aa1e1a5d74cd8/users/ac2cdd49f5524b30949a03a150018536/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:13.830660 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c6e5b-2915-407b-a123-880aeecedec8 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.840992 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c6e5b-2915-407b-a123-880aeecedec8 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.896131 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1952425-e1a9-4a3a-8393-26304953c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.896796 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1952425-e1a9-4a3a-8393-26304953c47c admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.897082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1952425-e1a9-4a3a-8393-26304953c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.897355 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1952425-e1a9-4a3a-8393-26304953c47c admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.898073 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1952425-e1a9-4a3a-8393-26304953c47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.899681 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1952425-e1a9-4a3a-8393-26304953c47c admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.913771 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1432/2885] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:13.918054 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f1738-7d4c-41bf-ac2d-1d2cf4e71b56 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:13.928819 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f1738-7d4c-41bf-ac2d-1d2cf4e71b56 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:13.933673 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bc1c7-9997-4288-9754-daa0cb09c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:13.934589 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bc1c7-9997-4288-9754-daa0cb09c48f admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.934878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bc1c7-9997-4288-9754-daa0cb09c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.935157 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bc1c7-9997-4288-9754-daa0cb09c48f admin admin] PATH_INFO: `/v3/projects/3973cffabf1848de972aa1e1a5d74cd8/users/ac2cdd49f5524b30949a03a150018536/roles/ef5f12c980f84a119b085158a63e6b22` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.937117 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bc1c7-9997-4288-9754-daa0cb09c48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3973cffabf1848de972aa1e1a5d74cd8, user_id=ac2cdd49f5524b30949a03a150018536, role_id=ef5f12c980f84a119b085158a63e6b22)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:13.939808 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bc1c7-9997-4288-9754-daa0cb09c48f admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:13.950712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1454/2886] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:13 2022] PUT /identity/v3/projects/3973cffabf1848de972aa1e1a5d74cd8/users/ac2cdd49f5524b30949a03a150018536/roles/ef5f12c980f84a119b085158a63e6b22 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:13.961916 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8883-9f8d-4d4c-9578-0606c10ab618 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:13.962208 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8883-9f8d-4d4c-9578-0606c10ab618 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:13.962542 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8883-9f8d-4d4c-9578-0606c10ab618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:13.989175 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-a02a8883-9f8d-4d4c-9578-0606c10ab618 None None] MFA Rules not processed for user `ac2cdd49f5524b30949a03a150018536`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:13.990376 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a02a8883-9f8d-4d4c-9578-0606c10ab618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:14.057643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1433/2887] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:14.068225 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bc1c7-9997-4288-9754-daa0cb09c48f admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:14.069924 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b52bc1c7-9997-4288-9754-daa0cb09c48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:14.126590 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bc1c7-9997-4288-9754-daa0cb09c48f admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:14.130091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1e998-df64-40cb-b1bd-23bca5b85a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:14.130748 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e998-df64-40cb-b1bd-23bca5b85a23 service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:14.131032 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e998-df64-40cb-b1bd-23bca5b85a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:14.131307 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1e998-df64-40cb-b1bd-23bca5b85a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:14.140156 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1e998-df64-40cb-b1bd-23bca5b85a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:14.141567 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1e998-df64-40cb-b1bd-23bca5b85a23 service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:14.150844 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1455/2888] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:14.673374 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a8883-9f8d-4d4c-9578-0606c10ab618 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:14.674822 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-a02a8883-9f8d-4d4c-9578-0606c10ab618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:14.695238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a8883-9f8d-4d4c-9578-0606c10ab618 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:14.699507 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe45b8-8e61-4fe0-9247-89b8b01d6fff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:14.700153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe45b8-8e61-4fe0-9247-89b8b01d6fff service cinder] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:14.700442 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe45b8-8e61-4fe0-9247-89b8b01d6fff service cinder] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:14.700721 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe45b8-8e61-4fe0-9247-89b8b01d6fff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:14.741923 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:14.757635 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe45b8-8e61-4fe0-9247-89b8b01d6fff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:14.759102 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe45b8-8e61-4fe0-9247-89b8b01d6fff service cinder] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:14.768379 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1434/2889] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:18.719855 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1e998-df64-40cb-b1bd-23bca5b85a23 service cinder] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:18.725107 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:18.729025 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1e998-df64-40cb-b1bd-23bca5b85a23 service cinder] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:18.733554 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472bde4-6333-429f-97c7-c42ba99844ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9cffe87117f447dacec4289f454a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:18.734185 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472bde4-6333-429f-97c7-c42ba99844ff service cinder] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:18.734513 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472bde4-6333-429f-97c7-c42ba99844ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:18.734787 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472bde4-6333-429f-97c7-c42ba99844ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:18.790289 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472bde4-6333-429f-97c7-c42ba99844ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:18.791753 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472bde4-6333-429f-97c7-c42ba99844ff service cinder] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:18.800563 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1456/2890] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:20.828229 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe45b8-8e61-4fe0-9247-89b8b01d6fff service cinder] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:20.889375 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe45b8-8e61-4fe0-9247-89b8b01d6fff service cinder] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:20.893758 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:20.894705 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:20.894986 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:20.895256 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] PATH_INFO: `/v3/users/2072f9c551504e16b45a7267b6551c80` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:20.896419 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2072f9c551504e16b45a7267b6551c80)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:20.898324 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:20.942755 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2072f9c551504e16b45a7267b6551c80'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:20.943408 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2072f9c551504e16b45a7267b6551c80'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:20.944016 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2072f9c551504e16b45a7267b6551c80'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:20.956189 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2072f9c551504e16b45a7267b6551c80'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:20.962942 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2072f9c551504e16b45a7267b6551c80'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:20.976018 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1435/2891] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:20 2022] DELETE /identity/v3/users/2072f9c551504e16b45a7267b6551c80 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:20.980738 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d9c9b-26fe-403f-8f83-d24f9f31b121 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:20.981240 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d9c9b-26fe-403f-8f83-d24f9f31b121 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:20.981342 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d9c9b-26fe-403f-8f83-d24f9f31b121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:20.998604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-873d9c9b-26fe-403f-8f83-d24f9f31b121 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:20.999794 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-873d9c9b-26fe-403f-8f83-d24f9f31b121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:21.066712 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1457/2892] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:44:21.076968 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:21.078456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:21.133557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a6021-f596-4784-a590-7d04fb1860de admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:21.137793 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9530cd1-7018-4e52-bef8-7bb50c6a86c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:21.138456 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9530cd1-7018-4e52-bef8-7bb50c6a86c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:21.138742 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9530cd1-7018-4e52-bef8-7bb50c6a86c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:21.139019 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9530cd1-7018-4e52-bef8-7bb50c6a86c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:21.147886 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9530cd1-7018-4e52-bef8-7bb50c6a86c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:21.149297 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9530cd1-7018-4e52-bef8-7bb50c6a86c6 service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:21.158600 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1436/2893] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:21.430957 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d9c9b-26fe-403f-8f83-d24f9f31b121 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:21.433014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-873d9c9b-26fe-403f-8f83-d24f9f31b121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:21.447615 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d9c9b-26fe-403f-8f83-d24f9f31b121 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:21.453364 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:21.454246 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:21.454626 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:21.454899 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] PATH_INFO: `/v3/projects/b6446bd24e684a39abe418f97adda5a9` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:21.456188 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6446bd24e684a39abe418f97adda5a9)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:21.458558 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:21.506065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6446bd24e684a39abe418f97adda5a9', 'request_id': 'req-b2579978-ceb5-45f1-b78e-23bb674f3cee'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:21.513218 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6446bd24e684a39abe418f97adda5a9', 'request_id': 'req-b2579978-ceb5-45f1-b78e-23bb674f3cee'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:21.518770 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6446bd24e684a39abe418f97adda5a9', 'request_id': 'req-b2579978-ceb5-45f1-b78e-23bb674f3cee'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:21.529396 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] The token cache is being invalidate because project b6446bd24e684a39abe418f97adda5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:21.529680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:21.530303 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:21.531868 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1458/2894] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:21 2022] DELETE /identity/v3/projects/b6446bd24e684a39abe418f97adda5a9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:21.535957 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9530cd1-7018-4e52-bef8-7bb50c6a86c6 service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:21.542480 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:21.546557 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9530cd1-7018-4e52-bef8-7bb50c6a86c6 service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:21.610670 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:21.611485 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:21.611772 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:21.612063 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] PATH_INFO: `/v3/users/3412bbb161034ab7af68729f7e06c4cf` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:21.613238 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3412bbb161034ab7af68729f7e06c4cf)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:21.615183 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:21.659965 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3412bbb161034ab7af68729f7e06c4cf'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:21.660607 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3412bbb161034ab7af68729f7e06c4cf'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:21.661218 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3412bbb161034ab7af68729f7e06c4cf'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:21.673575 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3412bbb161034ab7af68729f7e06c4cf'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:21.680780 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3412bbb161034ab7af68729f7e06c4cf'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:21.694117 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1437/2895] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:21 2022] DELETE /identity/v3/users/3412bbb161034ab7af68729f7e06c4cf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:21.958062 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:21.959540 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:21.978556 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579978-ceb5-45f1-b78e-23bb674f3cee admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:22.003881 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:22.037539 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:22.038465 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:22.038754 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:22.039034 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] PATH_INFO: `/v3/projects/e1c72d5ef891486cb0f475112964f762` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:22.040217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c72d5ef891486cb0f475112964f762)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:22.042891 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:22.087946 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c72d5ef891486cb0f475112964f762', 'request_id': 'req-732cde3d-a074-45e1-9baa-78ae38ba5883'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.095542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c72d5ef891486cb0f475112964f762', 'request_id': 'req-732cde3d-a074-45e1-9baa-78ae38ba5883'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.101217 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c72d5ef891486cb0f475112964f762', 'request_id': 'req-732cde3d-a074-45e1-9baa-78ae38ba5883'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.112593 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] The token cache is being invalidate because project e1c72d5ef891486cb0f475112964f762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:22.112882 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.113514 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.115067 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1459/2896] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:21 2022] DELETE /identity/v3/projects/e1c72d5ef891486cb0f475112964f762 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:22.119025 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:22.120698 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:22.133410 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e228d3-37db-4ca6-942b-1463d38e60f7 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:22.188880 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:22.189740 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:22.190026 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:22.190304 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] PATH_INFO: `/v3/users/ac2cdd49f5524b30949a03a150018536` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:22.191508 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2cdd49f5524b30949a03a150018536)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:22.193420 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:22.220232 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:22.238954 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2cdd49f5524b30949a03a150018536'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.239603 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2cdd49f5524b30949a03a150018536'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.240211 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2cdd49f5524b30949a03a150018536'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.252236 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2cdd49f5524b30949a03a150018536'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.259460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-e061199e-550e-4298-b6f3-54feadadad27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2cdd49f5524b30949a03a150018536'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.273978 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1438/2897] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:22 2022] DELETE /identity/v3/users/ac2cdd49f5524b30949a03a150018536 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:22.545710 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:22.547162 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:22.560597 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cde3d-a074-45e1-9baa-78ae38ba5883 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:22.621542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:22.622444 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:22.622734 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:22.623014 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] PATH_INFO: `/v3/projects/3973cffabf1848de972aa1e1a5d74cd8` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:22.624198 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3973cffabf1848de972aa1e1a5d74cd8)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:22.626112 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:22.670735 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3973cffabf1848de972aa1e1a5d74cd8', 'request_id': 'req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.677400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3973cffabf1848de972aa1e1a5d74cd8', 'request_id': 'req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.679310 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:22.684093 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3973cffabf1848de972aa1e1a5d74cd8', 'request_id': 'req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.695430 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] The token cache is being invalidate because project 3973cffabf1848de972aa1e1a5d74cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:22.695715 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.696337 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-43e2aeb9-e22a-4ea2-bac5-c982dafa79d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:22.698520 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1460/2898] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:22 2022] DELETE /identity/v3/projects/3973cffabf1848de972aa1e1a5d74cd8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:22.705870 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1dfb3-e4a7-467b-ba4e-41cb5d60d7ec None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:22.706152 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1dfb3-e4a7-467b-ba4e-41cb5d60d7ec None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:22.706532 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1dfb3-e4a7-467b-ba4e-41cb5d60d7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:22.724807 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-cbc1dfb3-e4a7-467b-ba4e-41cb5d60d7ec None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:22.726000 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-cbc1dfb3-e4a7-467b-ba4e-41cb5d60d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:22.782942 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1439/2899] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 10:44:22.791318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2803e-8f49-48be-b5af-964ef92a4ee3 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:22.791604 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2803e-8f49-48be-b5af-964ef92a4ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:22.791878 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2803e-8f49-48be-b5af-964ef92a4ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:22.810041 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-82f2803e-8f49-48be-b5af-964ef92a4ee3 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:22.811250 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-82f2803e-8f49-48be-b5af-964ef92a4ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:22.818926 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1461/2900] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:22.823673 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1dfb3-e4a7-467b-ba4e-41cb5d60d7ec None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:22.833161 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1dfb3-e4a7-467b-ba4e-41cb5d60d7ec None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:22.837781 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd5c3-92f1-48a8-aa24-7bb93c76373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:22.838529 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd5c3-92f1-48a8-aa24-7bb93c76373f admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:22.838814 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd5c3-92f1-48a8-aa24-7bb93c76373f admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:22.839091 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd5c3-92f1-48a8-aa24-7bb93c76373f admin admin] PATH_INFO: `/v3/domains` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:22.839804 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdd5c3-92f1-48a8-aa24-7bb93c76373f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 10:44:22.840110 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdd5c3-92f1-48a8-aa24-7bb93c76373f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:22.841685 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdd5c3-92f1-48a8-aa24-7bb93c76373f admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:22.852902 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1440/2901] 10.222.0.44 () {58 vars in 1152 bytes} [Fri Jun 24 10:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 10:44:22.857611 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2803e-8f49-48be-b5af-964ef92a4ee3 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:22.866723 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2803e-8f49-48be-b5af-964ef92a4ee3 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:22.872116 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6128f7-6f6e-4702-ad74-cced0eebaf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:22.872751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6128f7-6f6e-4702-ad74-cced0eebaf6a admin admin] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:22.873060 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6128f7-6f6e-4702-ad74-cced0eebaf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:22.873331 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6128f7-6f6e-4702-ad74-cced0eebaf6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:22.874007 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6128f7-6f6e-4702-ad74-cced0eebaf6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:22.875928 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6128f7-6f6e-4702-ad74-cced0eebaf6a admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:22.900065 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1462/2902] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Jun 24 10:44:22 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:22.904156 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd5c3-92f1-48a8-aa24-7bb93c76373f admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:22.914150 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd5c3-92f1-48a8-aa24-7bb93c76373f admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:22.969153 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d010c2-7f74-4ed4-888d-7953cb0175d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:22.969746 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d010c2-7f74-4ed4-888d-7953cb0175d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:22.970035 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d010c2-7f74-4ed4-888d-7953cb0175d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:22.970462 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d010c2-7f74-4ed4-888d-7953cb0175d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:22.971149 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d010c2-7f74-4ed4-888d-7953cb0175d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:22.973240 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d010c2-7f74-4ed4-888d-7953cb0175d0 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:22.992766 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1441/2903] 10.222.0.44 () {60 vars in 1143 bytes} [Fri Jun 24 10:44:22 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 10:44:22.997572 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6128f7-6f6e-4702-ad74-cced0eebaf6a admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:23.007867 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6128f7-6f6e-4702-ad74-cced0eebaf6a admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:23.012402 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe59920-823a-46d1-96e3-d52191f873b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:23.013056 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe59920-823a-46d1-96e3-d52191f873b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:23.013341 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe59920-823a-46d1-96e3-d52191f873b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:23.013622 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe59920-823a-46d1-96e3-d52191f873b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:23.014374 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe59920-823a-46d1-96e3-d52191f873b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:23.015979 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe59920-823a-46d1-96e3-d52191f873b3 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:23.026231 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1463/2904] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:23.029937 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d010c2-7f74-4ed4-888d-7953cb0175d0 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:23.039695 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d010c2-7f74-4ed4-888d-7953cb0175d0 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:23.044679 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ece47-9efd-4c69-a24a-cd4eeda3ae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:23.045314 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ece47-9efd-4c69-a24a-cd4eeda3ae41 admin admin] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:23.045598 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ece47-9efd-4c69-a24a-cd4eeda3ae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:23.045874 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ece47-9efd-4c69-a24a-cd4eeda3ae41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:23.046623 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ece47-9efd-4c69-a24a-cd4eeda3ae41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:23.048184 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ece47-9efd-4c69-a24a-cd4eeda3ae41 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:23.058620 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1442/2905] 10.222.0.44 () {58 vars in 1121 bytes} [Fri Jun 24 10:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 10:44:23.062183 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe59920-823a-46d1-96e3-d52191f873b3 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:23.071713 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe59920-823a-46d1-96e3-d52191f873b3 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:23.076238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c780e3-9e53-44e9-bc85-f5d508e5df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:23.077091 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c780e3-9e53-44e9-bc85-f5d508e5df41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:23.077370 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c780e3-9e53-44e9-bc85-f5d508e5df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:23.077646 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c780e3-9e53-44e9-bc85-f5d508e5df41 admin admin] PATH_INFO: `/v3/projects/4d76a331686c4c18a76f1dc2c16e89f8/users/6777e7811abe47999fb87d5e7171a944/roles/6c516ab551054fc8bd24c92c7d9173ba` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:23.093380 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c780e3-9e53-44e9-bc85-f5d508e5df41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d76a331686c4c18a76f1dc2c16e89f8, user_id=6777e7811abe47999fb87d5e7171a944, role_id=6c516ab551054fc8bd24c92c7d9173ba)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:23.096046 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c780e3-9e53-44e9-bc85-f5d508e5df41 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:23.109264 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1464/2906] 10.222.0.44 () {60 vars in 1482 bytes} [Fri Jun 24 10:44:23 2022] PUT /identity/v3/projects/4d76a331686c4c18a76f1dc2c16e89f8/users/6777e7811abe47999fb87d5e7171a944/roles/6c516ab551054fc8bd24c92c7d9173ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:23.121100 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cd411-d775-4860-a1e6-0328fc8733a8 None None] REQUEST_METHOD: `POST` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:23.121597 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cd411-d775-4860-a1e6-0328fc8733a8 None None] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:23.121710 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cd411-d775-4860-a1e6-0328fc8733a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:23.139577 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:23.149914 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.auth.core [None req-484cd411-d775-4860-a1e6-0328fc8733a8 None None] MFA Rules not processed for user `6777e7811abe47999fb87d5e7171a944`. Rule list: `[]` (Enabled: `True`). {{(pid=80112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:23.151344 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-484cd411-d775-4860-a1e6-0328fc8733a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:23.215143 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1443/2907] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:23.226454 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c780e3-9e53-44e9-bc85-f5d508e5df41 admin admin] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:23.228130 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-12c780e3-9e53-44e9-bc85-f5d508e5df41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:23.285003 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c780e3-9e53-44e9-bc85-f5d508e5df41 admin admin] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:23.288680 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f14fd-eda0-443b-9e50-d409d2112a9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe27c3402a741f0a80d87ae6ecd3f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:23.289327 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f14fd-eda0-443b-9e50-d409d2112a9a service glance] REQUEST_METHOD: `GET` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:23.289632 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f14fd-eda0-443b-9e50-d409d2112a9a service glance] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:23.289909 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f14fd-eda0-443b-9e50-d409d2112a9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:23.299052 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f14fd-eda0-443b-9e50-d409d2112a9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:23.300484 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f14fd-eda0-443b-9e50-d409d2112a9a service glance] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:23.309165 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1465/2908] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:33.211701 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=28 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:33.305238 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=58,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:48.825447 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cd411-d775-4860-a1e6-0328fc8733a8 None None] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:48.887550 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cd411-d775-4860-a1e6-0328fc8733a8 None None] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:48.892082 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:48.892939 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:48.893219 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:48.893493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] PATH_INFO: `/v3/users/6777e7811abe47999fb87d5e7171a944` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:48.894704 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6777e7811abe47999fb87d5e7171a944)` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:48.896643 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:48.941855 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6777e7811abe47999fb87d5e7171a944'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:48.942538 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6777e7811abe47999fb87d5e7171a944'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:48.943155 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6777e7811abe47999fb87d5e7171a944'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:48.954713 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6777e7811abe47999fb87d5e7171a944'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:48.962057 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.notifications [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6777e7811abe47999fb87d5e7171a944'} {{(pid=80112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:48.974413 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1444/2909] 10.222.0.44 () {58 vars in 1223 bytes} [Fri Jun 24 10:44:48 2022] DELETE /identity/v3/users/6777e7811abe47999fb87d5e7171a944 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:48.978857 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892e7cb-e464-4bb0-ab7b-b261915a4dc8 None None] REQUEST_METHOD: `POST` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:48.979318 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892e7cb-e464-4bb0-ab7b-b261915a4dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:48.979437 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892e7cb-e464-4bb0-ab7b-b261915a4dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:48.996818 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.auth.core [None req-b892e7cb-e464-4bb0-ab7b-b261915a4dc8 None None] MFA Rules not processed for user `7e9b1eea1bc44e2ab2c9802f041f72c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 10:44:48.998022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b892e7cb-e464-4bb0-ab7b-b261915a4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:49.055249 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1466/2910] 10.222.0.44 () {58 vars in 957 bytes} [Fri Jun 24 10:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 10:44:49.064638 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:49.066140 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:49.122885 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cffdb-9bc2-47e3-a1f4-64bd73e7e635 admin admin] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:49.126460 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5967d-e42a-4f13-8609-61804bdfabdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4160318c1b9b49539c6a2d8110289463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:49.127095 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5967d-e42a-4f13-8609-61804bdfabdd service neutron] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:49.127405 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5967d-e42a-4f13-8609-61804bdfabdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:49.127683 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5967d-e42a-4f13-8609-61804bdfabdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:49.136750 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5967d-e42a-4f13-8609-61804bdfabdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:49.138193 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5967d-e42a-4f13-8609-61804bdfabdd service neutron] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:49.147895 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1445/2911] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:44:49.424751 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892e7cb-e464-4bb0-ab7b-b261915a4dc8 None None] Authenticating user token {{(pid=80113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:44:49.426317 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.fernet_utils [None req-b892e7cb-e464-4bb0-ab7b-b261915a4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:44:49.438771 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892e7cb-e464-4bb0-ab7b-b261915a4dc8 None None] Validating token access rules against request {{(pid=80113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:44:49.443521 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9b1eea1bc44e2ab2c9802f041f72c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f43b9dcf7aae4875bca38a800d08c70f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:44:49.444382 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:44:49.444663 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:44:49.444937 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] PATH_INFO: `/v3/projects/4d76a331686c4c18a76f1dc2c16e89f8` {{(pid=80113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:44:49.446170 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d76a331686c4c18a76f1dc2c16e89f8)` {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:44:49.448173 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] RBAC: Authorization granted {{(pid=80113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:44:49.495542 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d76a331686c4c18a76f1dc2c16e89f8', 'request_id': 'req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:49.502463 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d76a331686c4c18a76f1dc2c16e89f8', 'request_id': 'req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:49.507874 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d76a331686c4c18a76f1dc2c16e89f8', 'request_id': 'req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5'} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:49.519129 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] The token cache is being invalidate because project 4d76a331686c4c18a76f1dc2c16e89f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 10:44:49.519400 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:49.520022 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG keystone.notifications [None req-5a2c898a-4e97-4c35-8ce0-53d8bf7d29f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 10:44:49.521678 dv-cinder-836996-38-smb devstack@keystone.service[80113]: [pid: 80113|app: 0|req: 1467/2912] 10.222.0.44 () {58 vars in 1232 bytes} [Fri Jun 24 10:44:49 2022] DELETE /identity/v3/projects/4d76a331686c4c18a76f1dc2c16e89f8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 10:44:59.143933 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:44:59.515726 dv-cinder-836996-38-smb devstack@keystone.service[80113]: DEBUG dbcounter [-] [80113] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:45:30.468776 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5967d-e42a-4f13-8609-61804bdfabdd service neutron] Authenticating user token {{(pid=80112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:45:30.470179 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-dbe5967d-e42a-4f13-8609-61804bdfabdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:30.606906 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5967d-e42a-4f13-8609-61804bdfabdd service neutron] Validating token access rules against request {{(pid=80112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:45:30.664832 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c343c6-d4c3-484b-b32c-4f90ec8ec5be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06d6f1eebcfa48349613455eb5d2aaf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded734adca05431f9db935b5734a757b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:45:30.665476 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c343c6-d4c3-484b-b32c-4f90ec8ec5be service placement] REQUEST_METHOD: `GET` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:45:30.665765 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c343c6-d4c3-484b-b32c-4f90ec8ec5be service placement] SCRIPT_NAME: `/identity` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:45:30.666045 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c343c6-d4c3-484b-b32c-4f90ec8ec5be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:45:30.667829 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.fernet_utils [None req-c0c343c6-d4c3-484b-b32c-4f90ec8ec5be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:45:30.678911 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c343c6-d4c3-484b-b32c-4f90ec8ec5be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:45:30.680493 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c343c6-d4c3-484b-b32c-4f90ec8ec5be service placement] RBAC: Authorization granted {{(pid=80112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:45:30.690369 dv-cinder-836996-38-smb devstack@keystone.service[80112]: [pid: 80112|app: 0|req: 1446/2913] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Jun 24 10:45:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:45:40.686133 dv-cinder-836996-38-smb devstack@keystone.service[80112]: DEBUG dbcounter [-] [80112] Writing DB stats keystone:SELECT=89 {{(pid=80112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}